Best of Twitter - September 9- October 23, 2022 (1/2)
bestoftwitter.substack.com
Best of Twitter - September 9- October 23, 2022 (1/2)
Since 1969 Strassen’s algorithm has famously stood as the fastest way to multiply 2 matrices - but with #AlphaTensor we’ve found a new algorithm that’s faster, with potential to improve efficiency by 10-20% across trillions of calculations per day!
5/ A most notable feature of Phenaki is its ability to generate long videos with *prompts changing over time*. These can be thought of as stories, where the user narrates and creates dynamically changing scenes. Here's a 2 minute (!) video from phenaki.github.io:
^ substack drops the framerate, the tweet has an actual video
If everything's a big manifold, why do neurons often code for human-interpretable factors? In arxiv.org/abs/2210.01768 we show the most efficient biological representation puts different factors in different neurons. This lets us build machines that disentangle too! 1/9
It's really disappointing how the last 30 years of relative peace might really be over now, and the world may be hurtling towards a global war. Right in time for AI too.
I am at a 25% chance of world war three before 2050 as of now (metaculus.com/questions/2534…).
"Chain of chain-of-thought" — A zero-shot GPT-3 prompt that sequentially solves 15 problems with references to prior answers, using chain-of-thought deduction for each, in a single text generation.
Generated at temperature=0. Playground link: beta.openai.com/playground/p/4…
key learnings over last few yrs:
1. strong intuition != intuition is right
-> don't trust intuitions without POKING&interrogation
->don't go >80% belief from intuition
2. nobody thinks from first principles and beliefs ~always just post hoc'd intuitions -> ~never defer beliefs
3. i can outargue anyone but unless my intuition is good and grounded (poking/tinkering/interrogation are necessary), just don't go >80% trust in arguments. Good chance of missing key ground level detail literally impossible to see without being on the ground level
4. ppl good at thinking think that thinking is everything; people good at execution think that execution is everything. neither are right and intersection of both is ~0 -> either find this intersection or talk to both thinkers & executors to get right picture
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
PaLM / Codex + CoT outperforms the average humanrater performance on many of the 23 challenging BIG-Bench tasks.
arxiv.org/abs/2210.09261
THREAD: The US government's new export controls are wreaking havoc on China's chip industry.
New rules around "US persons" are driving an "industry-wide decapitation."
