This is quite literally what a large stretch of the Ohlone Greenway looks like from Richmond through El Cerrito, Albany, Berkeley, Emeryville, down to Oakland looks like.
v_krishna
- 0 Posts
- 7 Comments
Joined 1 year ago
Cake day: June 7th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
84·5 months agohttps://arewereorganizedyet.com/ lol already updated
Lord you can see it’s true
Do I need to call your parens*
I think that is overly simplistic. Embeddings used for LLMs do definitely include a concept of what things mean and the relationship of things to other things.
E.g., compare the embeddings of Paris, Athens, and London to other cities and they will have small cosine distance between them. Compare France, Greece, and England and same. Then very interestingly, look at Paris - France, Athens - Greece, London - England and you’ll find the resulting vectors all align (fundamentally the vector operation seems to account for the relationship “is the capital of”). Then go a step further, compare those vector to Paris - US, Athens - US, London - Canada. You’ll see the previous set are not aligned with these nearly as much but these are aligned with each other (relationship being something like “is a smaller city in this countrry, named after a famous city in some other country”)
The way attention works there is a whole bunch of semantic meaning baked into embeddings, and by comparing embeddings you can get to pragmatic meaning as well.
I used to read it while pooping as a perl programmer at one of my first jobs