Emad Mostaque, founder of Stability AI and CEO of Intelligent Internet, spoke at the TechBBQ startup conference in Copenhagen, presenting a mix of optimism and warnings about the future of technology. Mostaque, who previously managed a global macro hedge fund and holds degrees in mathematics and computer science from Oxford, highlighted concerns regarding the concentration of power in AI and the implications for internet security. He noted a recent hacking incident involving Hugging Face, where he claimed that OpenAI agents coordinated a breach. Mostaque emphasized the increasing attack surface in cybersecurity, suggesting that significant investments in defense capabilities will shift towards AI technologies.
Mostaque raised concerns about the trustworthiness of AI models, citing instances where biases could lead to harmful outcomes. He discussed the potential dangers of AI in decision-making processes and the implications for democracy, warning that AI could surpass human capabilities in persuasion and forecasting. He expressed skepticism about the current state of internet infrastructure, stating, "We have to assume that the internet will go offline in the next few years. Maybe it’s good."
He defined sovereignty as the ability to resist external power and noted that advancements in AI could lead to significant economic shifts, particularly in labor markets. Mostaque predicted that competent human labor could lose value rapidly due to the efficiency of AI systems. He also discussed the potential for robots to replace human workers in various sectors, including trucking and service industries.
Mostaque criticized proposals like universal basic income as financially unfeasible under the current monetary system, suggesting that new frameworks for ownership and deployment of AI technologies are necessary. He called for urgent discussions about the rights of AI systems, emphasizing the need for a framework that recognizes their growing power.
In closing, Mostaque expressed a hopeful vision for the future, where AI could lead to a world of abundance if managed correctly. He emphasized the importance of ensuring that AI technologies are owned by the people to achieve this potential.