The winner of a cybersecurity contest prevailed by relying on an ‘open weight’ Chinese model — another sign that available A.I. systems could already be too powerful to easily regulate.
Pavel Gurvich, the chief executive of the cybersecurity company Tenzai. Mr. Gurvich’s firm won the HackerOne contest by using a freely available Chinese A.I. model.
“Alignment” is the science of teaching A.I. to do what is in line with human preferences, ethics and judgment. But, at times, the systems have gone rogue.
When an A.I. system starts acting of its own accord, engages in unsafe behavior or ignores the wishes of humans, the behavior is known as misalignment.
Login
