{"id":86642,"date":"2023-11-20T13:11:59","date_gmt":"2023-11-20T18:11:59","guid":{"rendered":"https:\/\/ifintechworld.com\/markets\/effective-altruism-contributed-to-the-fiasco-at-openai\/"},"modified":"2023-11-20T13:12:00","modified_gmt":"2023-11-20T18:12:00","slug":"effective-altruism-contributed-to-the-fiasco-at-openai","status":"publish","type":"post","link":"https:\/\/ifintechworld.com\/?p=86642","title":{"rendered":"Effective Altruism Contributed To The Fiasco At OpenAI"},"content":{"rendered":"
\n

In a surprising turn of events, OpenAI\u2019s board abruptly fired co-founder and CEO Sam Altman on Friday. Following a backlash on social media, the board appeared to be reconsidering its decision over the weekend, only to confirm that Altman was out early Monday morning. In turn, Altman will be leading a new AI research lab at Microsoft
\n MSFT
\n <\/fbs-ticker>.<\/p>\n

Altman has become the public face of the AI movement, thanks to ChatGPT\u2019s massive success. His removal means chaos in the short term for OpenAI and others in the industry. The real story however may be the OpenAI board\u2019s concerns about \u201cAI safety,\u201d which in turn stem from the outsized influence of Effective Altruism in Silicon Valley. The safety of AI likely created a key rivet between the board and CEO Altman.<\/p>\n

EA is a philosophical framework rooted in utilitarianism, which aims to maximize the net good in the world. In theory, there\u2019s little to dislike about EA, with its rationalist approach to philanthropy that emphasizes evidence over emotion. The problem is the movement\u2019s leaders are all too prone to ethical lapses, confirming the very worst stereotypes of the movement\u2019s critics.<\/p>\n

For example, Sam Bankman-Fried, the disgraced FTX founder and devoted effective altruist, showed how EA\u2019s \u201cearning to give\u201d philosophy\u2014which promotes making a lot of money so that one can later give it away to charity\u2014can easily turn into \u201cearning at any cost,\u201d even if it means defrauding millions of investors in the process. Similarly, EA leader and philosopher Peter Singer recently defended<\/a> human-animal sexual relations on the social media app X, highlighting the movement\u2019s creepy connections to the most perverse corners of intellectual libertinism.<\/p>\n

<\/fbs-ad><\/p>\n

While the current crop of EA leaders may be comprised of fraudsters and crackpots, utilitarianism has a long and storied history that has at times included great philosophers like Jeremy Bentham and John Stuart Mill. Utilitarianism sees the collective interest as superseding that of the individual, like sacrificing a single healthy person to harvest their organs and save five others.<\/p>\n

The OpenAI board is comprised of current and former effective altruists, and debates over AI safety likely contributed to Altman\u2019s removal, highlighting how the EA-friendly board was in tension with the business savvy and mostly profit-seeking Altman. OpenAI awkwardly straddles sectors, technically a non-profit, but with responsibilities to earn profits for some investors, like Microsoft. After launching ChatGPT and working with Microsoft, the board may have thought OpenAI had strayed too far from the nonprofit\u2019s original mission of open and safe AI.<\/p>\n

But even early AI safety proponents like technologist Nick Bostrom now avoid<\/a> the extreme predictions that set off the doomers in the first place. Bostrom\u2014who promotes \u201clongtermism,\u201d another key EA concept\u2014apparently doesn\u2019t want to associate himself with bloggers like Eliezer Yudkowsky<\/a>, who predict the end of the world on a near-hourly basis.<\/p>\n

Ultimately, the nonprofit, EA-influenced arm of OpenAI won out, but the company may well be destroyed in the process. Along with Altman, the president of OpenAI Greg Brockman and a number of top researchers have already fled the organization. The trickle may soon<\/a> be a flood.<\/p>\n

The whole episode demonstrates how nonprofits, which depend on fickle directors, are often the ones that most stray from the public good, making rash decisions based on short-sighted impulses and bruised egos. Meanwhile, for-profits at least have a solid grounding in seeking to protect the investments of their shareholders. This focus on returns is like a compass that keeps for-profits guided toward their missions.<\/p>\n

Effective altruism is a poor replacement as a lodestar guiding the non-profit sector. The good aspects of EA, like its emphasis on evidence-based solutions, are not novel, and indeed there are plenty of good alternatives to EA that are more attractive in this regard. The bad aspects, meanwhile, appear irredeemable.<\/p>\n

EA\u2019s leaders have demonstrated that they are willing to defraud investors, push the boundaries of civilized behavior, and wreck some of society\u2019s most innovative companies, all if it conforms with whatever myopic vision of the good is in their heads at a particular moment.<\/p>\n

Far from being a longtermist worldview, EA is a short-sighted one. OpenAI\u2019s board is far from the worst of EA\u2019s practitioners. Nevertheless, this weekend\u2019s events capture how the movement tends to elevate people with serious blind spots to positions of prominence and influence.<\/p>\n

Too many effective altruists are willing to resort to depravity if they believe it will do good over the long term. But what kind of precedent does this set? Why should we expect future effective altruists won\u2019t sink to similar depths, if all one needs is to concoct some self-serving justification to do evil?<\/p>\n

The problem with utilitarianism more broadly as a philosophy is it incomplete. Doing the most overall good provides significant guidance, but it can\u2019t be the whole story. Sacrificing one\u2019s self for the long-run interests of a society cannot be the only principle upon which a society is built. Not only is this a recipe for misery, it is contrary to basic human nature. Self-interest, for better or worse, must also at some point enter the expected value calculation.<\/p>\n

While OpenAI currently leads the race in AI, expect new leaders to emerge given the company\u2019s internal turmoil. But the biggest bet should be against EA. However reasonable some aspects of it may be, the charlatans the movement attracts should give us serious reservations about its moral authenticity. Too many of the tech industries\u2019 worst promote EA, revealing a rot that eats away at the heart of one of America\u2019s most innovative sectors.<\/p>\n

With Altman\u2019s ouster, it\u2019s clear that EA\u2019s corrupting influence has infected even admired companies like OpenAI. If OpenAI represents Silicon Valley\u2019s moral compass, it appears we are all in for some rough waters ahead.<\/p>\n<\/div>\n