AI-driven concentration of economic and political power

“somehow negotiate a truce between themselves to share power and then ideally spread that power out amongst the government and get the legislative branch involved you know somehow that has to happen too otherwise you end up with like this horrifying dictatorship or oligarchy and like it feels like all that stuff has to go right and we depict it all going mostly right in one ending of our story but uh yeah it's kind of rough”

Expects: Failure to establish power-sharing and broader government involvement could result in a dictatorship or oligarchy. · no date given · not yet resolved

“and then he made the point like okay fine whatever nanobots uh maybe like nanobots there's not a crux here the crux at least um to the thing he cares about which is human control is just by when can the robot economy whether or the ai economy whether it's the result of capital deepening or whether it's a result of r&d by when will they have just like the robots and they've they have more sort of like cumulative of physical power than i don't know what the analogous thing here is but you you see what i'm saying and so he's concerned about by when will they even if they're ordering components off of um alibaba or whatever by what and sorry i'm being trying maybe you see what i'm saying like even if they're integrated in those supply chains by when are they in a position where because this like part of the economy has been growing much faster they can they they could like take over the government or that's”

Expects: Whether an AI- or robot-driven economy could accumulate enough physical power to take over government while participating in existing supply chains. · no date given · not yet resolved

“You know, do we risk becoming a dictatorship or some sort of crazy oligarchy or whatever?”

Expects: Concentrated control of AI could risk leading to a dictatorship or oligarchy. · no date given · not yet resolved

“And so there's just this worry that you have models which will basically consolidate all businesses in the world. or at least all current businesses in the world, or at least all current white-collar businesses in the world,”

Expects: AI models could consolidate all businesses worldwide, or at least all existing businesses or existing white-collar businesses. · no date given · not yet resolved

“I don't know. I don't unless AI progress slows down, unless governments regulate the fuck out of it. This is all that happens, in which case it was headed for a world where either we have super concentration of resources and we pray that that one company gets everything right.”

Expects: The speaker expects AI to produce an extreme concentration of resources, leaving society dependent on one company getting everything right, unless AI progress slows or governments impose very heavy regulation. · no date given · not yet resolved

“So just like the AI is actually getting out of control to concentration of power. So like”

Expects: AI-driven concentration of power will be a major problem on the horizon. · no date given · not yet resolved