Follow

artificial intelligence, climate change 

paper estimates that training Google's 213M Transformer language model produced 626,155(!) pounds of carbon dioxide technologyreview.com/s/613630/

psst, markov chains are the solarpunk GPT-2, pass it on

Show thread

artificial intelligence, climate change 

artificial intelligence, climate change 

@aparrish So this is roughly equivalent to building four houses (in the UK). If you'd told me Google's ML team built and demolished four houses while training that model, I'd probably just shrug and pass it off as Silicon Valley weirdness.

artificial intelligence, climate change 

@mewo2 yeah, that's a good and interesting comparison. (I should have posted less sensationalistically about it, since I'm actually drafting an e-mail to my faculty list right now that amounts to "not all models..."—and reading the paper I'm actually surprised at how *little* energy it takes to train some of the models.) still, I feel like many otherwise savvy people don't even know enough to bring up externalities like CO2 emissions in discussions about AI

artificial intelligence, climate change 

@aparrish @mewo2 yeah, I feel like the article is misrepresenting:
> process of deep learning has an outsize environmental impact.
Is it outsized? If you train a machine learning model using millions of dollars of computation time, there will also be a significant carbon impact. But that impact is small compared to spending the same amount of money on cars or travel. It might be interesting to compare to other industry processes.

artificial intelligence, climate change 

@mewo2 @aparrish Finally they're getting back to Google's core mission statement, demolishing the world's homes

artificial intelligence, climate change 

@aparrish I suppose going forwards with A.I's we should definitely take even the miniscule of emissions into account.

Sign in to participate in the conversation
Friend Camp

Hometown is adapted from Mastodon, a decentralized social network with no ads, no corporate surveillance, and ethical design.