Inaugural post
Dec. 5th, 2018 03:08 pm![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png)
This is a post intended to lessen the activation energy necessary for me to post. Note that I'm still figuring out tags, comments, notifications, etc.
To help me figure out the comment system, please leave a brief comment about exactly one of the following:
To help me figure out the comment system, please leave a brief comment about exactly one of the following:
- your favorite animal
- the last book you fell in love with and why
- your opinion of eliezer yudkowsky
- whether you love the color of the sky
no subject
Date: 2018-12-05 10:09 pm (UTC)no subject
Date: 2018-12-06 11:52 am (UTC)no subject
Date: 2018-12-07 08:37 am (UTC)See That Alien Message, specifically that part:
" A Bayesian superintelligence, hooked up to a webcam, would invent General Relativity as a hypothesis—perhaps not the dominant hypothesis, compared to Newtonian mechanics, but still a hypothesis under direct consideration—by the time it had seen the third frame of a falling apple. It might guess it from the first frame, if it saw the statics of a bent blade of grass."
Ignoring the part where the superAI has managed to make sense of what if was seeing through the webcam, it will absolutely not be able to do what is suggested with the 3 frames of the apple falling (or with the one of the blade of grass). The instrument simply does not have the resolution to allow such a feat. This is a key misunderstanding. This whole sequence is pretty bad tbh.
(the common way to not grok the practical side of science is to say "Singularity!". Every time you say "Singularity", an experimentalist has a stroke. Please think of the experimentalists)
no subject
Date: 2018-12-07 11:35 pm (UTC)The model of learning-about-physics I'm getting from "This Alien Message" is like this:
1. The intelligence receives some kind of data.
2. The intelligence wonders what it means, and constructs several theories, which may be far-fetched or complicated.
3. The intelligence receives further data, which supports or rules out various parts of theories.
4. Goto 2
Is your objection that this is unlike the way science works in our civilization? Or that there would not be enough data for the intelligence to consider relativity as a theory?
no subject
Date: 2018-12-10 02:41 pm (UTC)This is very important. It's not just a misunderstanding by Eliezer about the resolution of the data, but also about how you build theories from experimental data.
(I would have little objection* to a statement such as "given knowledge of the state of physics in the 1880s, the intelligence will come up with, at the very least a set of experiments to perform to resolve issues with Newtonian mechanics and, possibly, the first bricks of relativity)
*on those grounds
no subject
Date: 2018-12-08 09:28 pm (UTC)no subject
Date: 2018-12-10 02:50 pm (UTC)The argument one could oppose that is not really in contradiction with the quoted passage is the one from sophistication/complexity, as Eliezer allowed for "perhaps not the dominant".