Show newer

what do you call a gan that doesn't work 

a gan't

Show thread

allison learns about... gans 

apparently the answer to "why isn't my gan working" is usually "well why didn't you put more batch normalization in there, hotshot"

(currently trying to hack the dcgan model I've been using to generate conditioned on labels, with only sputtering success, woo)

allison boosted

what idiot called it vaccination and not a cowpoke

allison boosted

Folks with experience in nonprofit development and marketing: https://pyfound.blogspot.com/2020/12/psf-is-hiring-director-of-resource.html The Python Software Foundation is hiring. Remote full-time job; I can recommend the Executive Director and other staff (I have contracted with them frequently).

"doing this" = using DistilBERT to gradually transform a sequence words picked at random from a word list into text that appears to make sense

Show thread

okay I THINK I finally found a way of doing this that comes close to meeting all of my criteria for this project (i.e., each step shows visible and meaningful change; the change is gradual, but the result "converges" after relatively few steps): calculate the probability of token in source text vs. token sampled from the distribution of mask token at that position, then find "peaks" of improbable tokens, and replace w/sampled token at those peaks; stop when any output repeats

Show thread
allison boosted

I gave a set of 2020 headlines to the neural net GPT-3, whose training data cut off in October 2019.

Having never seen 2020, it tried to predict what headlines are next on the list.

https://aiweirdness.com/post/637497177623724032/2020-headlines

allison boosted
allison boosted

after im done with god im coming for the unicode consortium

ANYWAY the goal of all this was to make poem things with the word image GANs I trained for NaNoGenMo last year—here's a result from the first working implementation! (now the question is: do I go easy on myself and generate a book with one poem per page, or do I let the poems stretch across pages, or do I try to group shorter poems on the same page, etc. etc. etc.)

Show thread
allison boosted

something that I don't see discussed too much in the push to get off of election/web technologies is the impact that has on displaying non-latin text. if you are writing your own text renderer you are almost guaranteed to get it wrong when it comes to languages you are not familiar with. arabic is particularly badly served in this regard and I collect the many fuck ups on notarabic.com

for all of its faults (and there are many!) the web stack is still one of the best ways to not mess up text...

hey fediverse, one of my (computer-generated) poems is on the cover of BOMB Magazine's Winter 2021 issue! there are also several new poems from the Compasses series inside bombmagazine.org/issues/154/

okay I guess today is a day where I'm just going through a bunch of nlproc papers?? I love this example output from "Controlled Affective Text Generation" (columns from left to right: text completion prompt for the language model; desired topic; desired emotion; "knob" value adjusting emotional intensity; text output) paper link: wordplay-workshop.github.io/mo

"common sense" AI, gender, ethics 

original paper here: arxiv.org/abs/1906.05317 it really sucks that this paper has pretty much no discussion of how the use of a pre-trained language model increases the potential for harm—as just one example, the ConceptNet node for "transgender" is likely curated and more or less informative conceptnet.io/c/en/transgender but putting "transgender" into COMeT... basically spits out a bunch of harmful stereotypes

Show thread

"common sense" AI, alcohol mention 

it's like the AI says. I'm hot, drunk, cool, dead and cute and I need you to to drink beer and study hard

Show thread

"common sense" AI, alcohol mention 

playing around with COMeT (language model trained on knowledge base tuples from ConceptNet) mosaickg.apps.allenai.org/come

allison boosted

I've written a Q&A about Amazing Quest, my controversial (or maybe just despised?) #C64 BASIC game which just was rated 98th out of 103 in the Interactive Fiction Competition

https://nickm.com/post/2020/12/amazing-quest-qa/

more fun with DistilBERT: iteratively expanding a sentence by inserting a mask token *between* random adjacent tokens and predicting the most likely token for that position with the model

Show thread

this is a cool site for finding out what features your variable fonts support wakamaifondue.com/ easier than what I did, which is dig through the python freetype bindings to find the completely undocumented function that maps to the barely documented "multiple masters" header in freetype or whatever 😎

Show thread
Show older
Friend Camp

Hometown is adapted from Mastodon, a decentralized social network with no ads, no corporate surveillance, and ethical design.