automation bias

Automation bias is the tendency to rely too heavily on automated systems, such as computer algorithms, to make decisions. It is a form of cognitive bias that can lead to incorrect decisions and can result in a lack of critical thinking. Automation bias can lead to problems when the automated system is not perfect, as humans may not be able to recognize that the system is making mistakes. Automation bias can also lead to a lack of accountability, as the automated system may be seen as a “black box” that is not subject to scrutiny or oversight. Automation bias can also lead to an over-reliance on the automated system, leading to a lack of creativity and innovation.