Field of Science

Gödel's Proof

There is an idea of reason in the Universe. It is an abstraction which mathematicians have never been content with. Given that scientists exclusively use logic (or mathematical reasoning) for theories and experiments it is of incredible importance to know the limits of logic. It turns out that the study of math itself, metamathematics, has amazing insights on what is knowable.

In 1931 an unassuming paper was published in a German mathematics journal, the title of the paper (translated to English) was 'On Formally Undecidable Propositions of Principia Mathematica and Related Systems I'. It is a confusing title and the kind of paper which I would not understand. The author was a 26 year old Austrian named Kurt Gödel and he had just created a revolutionary idea, but as with so many great ideas it was not simple and it took great minds to fully appreciate it.

The ideas he put forth have been extremely influential and the collective name for the theories that grew from it are known as Gödel's incompleteness theorem. This theorem is a revolutionary outcome in mathematical logical that has implications for not only the philosophy of mathematics, but philosophy in general. It is thus surprising how relatively unknown the theorem is to the general public and even many scientists. I recently read the book Gödel's Proof by Nagel and Newman in just a few sittings at a coffee shop. It is a short and concise explanation of the proof that incrementally brought me closer to understanding the intricacies of Gödel's works.

Gödel's incompleteness theorem is a massive mountain of ideas that I will not attempt to conquer, but I think it is important that everyone at least gets a view. Gödel basically found that no solid guarantee is possible that mathematics is entirely free of internal contradiction. However, Gödel was not out to trash mathematics, contrarily he used mathematics itself to temper the reach of mathematics and place constraints on what is possible to known through mathematics much like a physicist theorizing that a black hole's event horizon places a limit on spaces which the physicist could actually go and measure. Gödel created a new technique of analysis and introduced new probes for logical and mathematical investigation.

The specifics of Gödel's proof even as outlined on wikipedia are extremely complicated (the entire proof is long and there are on the order of 200 links in the article so by the time you were done reading all of the prerequisite mathematical definitions you would have read thousands of pages) for anyone without (or with) extensive mathematical training, so I must admit that I don't understand it completely and not have I attempted to read the actual paper. I want to present here the shortest definition of Gödel's theorem not the the most rigorous.

The key to Gödel's incompleteness theorem is a concept of mapping. In the information age the concept of mapping or coding is familiar to many as in the case of mapping Morse code dots to letter characters. In the explanation that follows take it as a given that it can be shown that all logic systems are equivalent to or mappable to the operators we will be using; this assumption is vital, and I can't quite explain it without detail so I refer the inquisitive mind to read Nagel and Newman's book.

Let us construct a simple logic system using the arbitrary operators P, N, ⊃, and x that have certain properties which we take as given by the table defined below. In the left column a combination of operators is given and in the right column a definition in English of the operators meaning is given.

P⊃x    'print x'
NP⊃x    'never print x'
PP ⊃x    'print xx'
NPP⊃x    'never print xx'

We can combine these statements and create more complicated statements. For example P⊃y where y=P⊃x would mean 'print P⊃x' (note that implicitly I am also using the equals operator). Crucially then NPP⊃x would mean 'never print xx', and this statement could also be written NP⊃xx.

Next ponder what the last statement used on itself means. The statement NPP⊃y where y=NPP⊃ would mean 'never print NPP⊃NPP⊃', but this strange statement could also be written NPP⊃NPP⊃.

So either our system prints NPP⊃NPP⊃ or it never prints NPP⊃NPP⊃. It must do one or the other. If our system prints NPP⊃NPP⊃ then it has printed a false statement because the statement contradicts itself by self reference once it is printed. On the other hand if the system never prints NPP⊃NPP⊃ then we know that there is at least one true statement our system never prints.

So either there are logic statements which may be printed which are false statements, or there are true statements which are never printed. Our system must print some false statements if it is to print all true statements. Or our system will print only true statements, but it will fail to print some true statements.

In the example above I have taken arguments very similar to that in Raymond Smullyan's book Gödels Incompleteness Theorems in order to create an extremely concise, but hopefully accurate description of what lies at the core of Gödel's insight. In Nagel and Newman's book they explain Gödel's proof in much more detail by working out the details of mapping. For example in the explanation above I mapped mathematical statements to the idea of printing, but print could be equivalently be existence. Further, Nagel and Newman argue as Gödel did that all formal axiometric systems can be mapped in some way such that even the most complicated mathematical systems using the common operators of +,-,=, x,0,(,),⊃ and so on can be shown to be incomplete.

Gödel's incompleteness theorem has many forms and implications. Briefly I will demonstrate an analogous, but weaker form of Gödel's incompleteness theorem by analogy to the halting problem. I believe this demonstration is of importance to those of us immersed in the information age and perhaps easier to grasp or at least more applicable than Gödel's work.

The halting problem is to decide whether given a computer program and some input, whether the program will ever stop or will it continue computing infinitely. The key to the halting problem is the concept of computation and algorithms. In the original proof by the enduring Alan Turing specific meanings to the concepts of algorithm and computation were defined. He used a computational machine now known as a Turing complete computer, or a Turing machine. The definition of what constitutes a computer is to the halting problem what the mapping of symbols is to Gödel's theorem. It is at the heart of the problem, and thus actually one of the harder points to define so I will again leave that task as an exercise to the reader.

So lets look at two psuedocode programs and lets imagine that we also have a very special program written by a genius scientist which is called Halting. The scientist claims that Halting can correctly tell your own code B(P,i) whether a program halts.

Program B(P,i)
  if Halting(P,i)==true then
    return true // the program halts
  else
    return false // the program does not halt



Now here is the important part. The genius scientist claims we can analyze any kind of computer program, this is indeed the crux of the halting program, we want to know if any and every program stops. Now imagine a program E that takes X, which is any program, as an argument.

Program E(X)
  if B(X,X)==true then
    while(true) //loops forever
  else
   return true



The first thing E does is take B and passes it X for both arguments. Program E will get back from B either true or false. If it receives back true it will enter an infinite loop and if it receives back false it will terminate.

So suppose I take B and feed it E for both arguments. What answer will B(E,E) give? Think about it.

We will be running our special Halting program on E(E) which will then run the program B(E,E). The answer to B(E,E) will either be either true or false. If the result is false the program E actually returns true and halts immediately; if the result is true then Halting thinks our program does halt, but the program E throws itself into a loop upon this condition and will never halt. Either way program E lies. E was written very craftily to break B on purpose, but nonetheless the damage is done. E cannot be made reliable even in principle. It matters not how clever you are and or how powerful your computer is. There is simply no reliable computer program that can determine whether another program halts on an arbitrary input. The incompleteness problem may have seemed a little bit distant and philosophical, but if you have read this far it should be evident that the halting problem has deep implications computing.

What does Gödel's theorem mean for the real word, experimental verification, and deductive sciences? Well take for example the Banach-Tarski paradox which states that a solid ball in three dimensional space can be split into a finite number of non-overlapping pieces, and then be put back together in a different way to yield two identical copies of the original ball. This process violates sensible physic notions of conservation of volume and area. It turns out that Banach and Tarski came to this conclusion based upon deductions from the Axiom of choice. Now, whether we know anything at all about the axiom of choice we do know that the deductive conclusions drawn from it are in violation of physics. Thus, a physicist could argue that the axiom of choice is not a valid axiom for our Universe. Within mathematics it is unknown, unprovable Gödel says, whether or not we should accept the axiom of choice, because it is after all an axiom. The argument for whether a given axiom is to be accepted must be discussed outside the confines of the logic structure one is arguing about. It turns out that the axiom of choice is important for many other really important mathematical proofs which are used in physics all the time. I don't know what to make of it really, perhaps a mathematician out their should weigh in on this question.

Another important theorem that goes along with Gödel's theorem is Tarski's undefinability theorem. Tarski's undefinabtliy theorem makes a more direct assertion about language and self referential systems. Basically any language sufficiently powerful to be expressively satisfying is limited. In summation we have two vital points to the concept of incompleteness.
  1.  If a system is consistent, it cannot be complete and is limited.
  2. The consistency of the assumptions or axioms cannot be proven entirely within the system.
The repercussions of the meta analysis of logic are profound and subtle. Gödel really has thrown us for a loop. It is unclear if we should draw the line and say this is just a mere curiosity of mathematics or a deep truth about the Universe. It has been proposed by Douglas Hofstadter (author of Gödel, Escher, Bach) that consciousness itself comes from a kind of 'strange loop' induced by a self referential system in our minds. Primarily, I think we can conclude that Gödel's incompleteness theorem implies that in most situations the tools science has to analyze the world are more than adequate because the situations are not self referential. However, I do see a limit to what we can know about the Universe. As physicists forge forward, generally quite successfully, in understanding the Universe it appears that there really is some consistent mathematical basis for our Universe. Many physicists are searching for this mathematical basis to the Universe, it is the so called theory of everything. But does Gödel's result imply that this mathematical basis cannot be self consistent?

Consider this scenario. One day our most powerful, successful, and comprehensive theory ever will predict something that experiment cannot verify or worse an experiment will patently disagree with. Some will argue that the theory must be thrown out because classically the scientific method states that a theory disagreeing with experiment, or making nonsense predictions, is untenable. Another theory will be introduced that makes consistent and testable predictions, however this theory is not able to predict the most intricate traces of nature. Actually, that first case kind of sounds like string theory. Perhaps we will have to start talking about theories being incomplete instead of wrong one day.

G34.3

Wow, there really is something new to learn everyday.

I Hate Astrology

Perhaps it is cruel to snuff out the shinning gleam in the eyes of a person who upon hearing that I am an astronomer exclaims, "Oh, I love astrology!" and  I reply, "No, I study ASTRONOMY." But they don't understand it. The subtle differences in syllables of the words belies the vast gulf in empirical tendencies between the separate endeavors and it is too much to explain. I simply walk away.

I hate astrology and I hate when people get astronomy and astrology mixed up. I could be more understanding, but I have to choose my battles. I meet a lot of interesting people in coffee shops, bars, airplanes, parties and wherever else life takes me and when someone gets excited about the fact that I study astronomy it means they have a deep curiosity about the skies above. That curiosity is occasionally deeply misguided with astrology and their questions are so fundamentally misconceived I struggle to answer them with candor and accuracy (for example they ask, 'Do the planets affect our daily lives?' and I hesitate to answer honestly that we must consider their gravitational pull, so the answer must be yes). On the other hand I meet people who are genuinely interested in massive collections of gravitationally bound glowing gas and I am very happy to answer their questions.

There is a real danger when logic, or pseudologic, is applied to astrology. Recently there was an uproar about the shifting of the zodiac that made it into some news headlines. Briefly I shared the frustrated sentiments of astrologers because the shifted zodiac has been well known for some time, why is the public just now hearing about it? The book in the image above is from the seventies and claims right there on the cover that, 'Most astrology is unscientific and inaccurate', and goes on to explain the shifted zodiac and how to have a movie ending romance. The ideas in this book are the apotheosis of dangerous thought. A little bit of knowledge is a very dangerous thing when combined with pseudologic in the guise of rigorous proof. It has also not escaped my observation that many of the people I have known who believe in astrology also believe in God as if to demonstrate the utter confusion and inconsistency of their minds. I don't mean to badger defenseless people here. This is simply an honest expression of how I feel. I have summed up my sentiments into a paragraph which I think would be nice to place on a card with which to hand out to people who confuse astrology with astronomy:

I cannot rightly conceive of a logic which would allow one to study such disparate phenomena of love, planets, stars and come to see any connection. Perhaps, desperate for meaning people find it wherever they look; conclusions are forged before the data have been taken. Those who would apply science to astrology may as well attempt to apply science on whom to love and sociologists do study what makes a lasting relationship and neurobiologists study what chemicals are active in the brain during feelings of love, but no scientist will claim that Romeo shouldn't love Juliet. I believe science and an understanding of natural phenomena adds to the beauty life, but pseudologic and lies even when propagated with good intentions ultimately lead to pain and suffering. The human mind has the ability to find patterns anywhere, indeed often where they do not exist.

Making sense of a visible quantum object


Quantum mechanics predicts that nature is fundamentally uncertain. Particles are in multiple states at once; particles are here and there. As we extrapolate these properties of nature to macroscopic objects the results are counterintuitive. The counterintuitive predictions of quantum mechanics should be an observable phenomena, and indeed they are. In this talk the intuition is examined and in this paper by the same physicist, Aaron O'Connell, the physics is examined.

So I haven't been posting lately. I have been drowned in opportunities, hit by funding woes, and frankly it feels like my mind is melting. I will probably post more aggregated non-original content, like this post, but I also have lots of ideas and new things I am working on.

Flying is Unsustainable

Today I am crossing Australia, the Pacific, and then the West Coast by airplane and I feel guilty. You see everything that I do in my daily life to be environmentally friendly is nullified by my airplane travel. Even if I was completely carbon neutral in my daily life the excessive amount of airplane travel that I partake in each year would place me me in the same ranks as the worst polluters in America. According to a green manifesto (also see this description of 'low-energy astrophysics') by astrophysicist P.J. Marshall and others the average energy consumption per day of a person in the U.S. is 250 kWh/day/person. An astrophysicist uses an extra 133kWh/day/astronomer, yet the vast majority of that additional energy usage, 113 kWh/day/astronomer, is contributed by flying. The key message of the manifesto is that while astronomers are not actually a significant energy consumer in the U.S. (they use 0.001% of the national total energy production) we are high profile scientists who must set an example. Astronomers believe global warming is real, and thus must act.

Astronomy in Western Australia

Murchison, AUSTRALIA - Building a radio telescope is nothing like working on an optical telescope, except that both bring you to remote areas. Western Australia reminds me of the Texas hill country. I grew up in Texas and as simple as I can describe it Western Australia is like an upside down Texas. And the people they are nearly the same: they have thick accents, more land than they know what to do with, and national pride. It is hard to describe everything so here are a few pictures of what I have seen out here.

This is a massive 12 meter radio dish from the experiment next door. Western Australia is perfect for radio astronomy. There are very few people and no radio stations to interfere with the data. Several other projects, most importantly the Australian Square Kilometer Array Pathfinder (ASKAP), are very nearby to the Murchison Widefield Array (MWA). Australia is pushing to develop an infrastructure and technical knowledge base in a bid to host the Square Kilometer Array which will be the ultimate next generation radio telescope.

A Bungarra has come to visit MWA! A Bungarra or Sand Goana is a type of monitor lizard common in this part of Western Australia. They are big critters with a swaggering gate and curious yet skittish attitude. This one was wandering around our site for some time. I think he was as equally curious as to what we were doing as to I was about what he was doing. The big white box is a receiver that takes input from the antennas which we were testing.

The self reliant mind set is necessary out here. I am on what an American would call a ranch, but what they call a station. The stations muster, or as I would say drive, thousands of head of cattle and sheep to turn a profit. We were driving along the road one day on our 40 kilometer commute from the station to the antennas when we came upon this airplane. The station manager flies it around to help spot and muster the livestock because it is one of the only ways to find anything on 900,000 acres of land. There are lots of subtle differences to the stations round here to what I would expect in Texas actually. For example there are kangaroos instead of deer, and they don't use horses to muster they use dirt bikes.

This image is a track left by a Bungarra marching off into the distance. Long before the scientists, engineers, or even the ranchers converged onto this remote land an indigenous population known as the Wajarri lived here. Bungarra and their eggs were, or rather still are, a source of food for these people. The Wajarri, like other Aboriginal peoples in Australia, have a different cultural background which is hard for myself and many other westerners to comprehend. What is clear to me is that ancient wisdom still matters in this modern world because humans have a tendency to overreach; technology allows us to do many things, but what should we choose to do? The Wajarri people seem to agree that we should do astronomy as they have allowed us the use of their land for radio astronomy. Perhaps a desire to understand our place in the Universe is a shared cultural value.

A Primer on Radio Astronomy from Australia

Murchison, AUSTRALIA - I am seemingly in the middle of nowhere, and yet I do not doubt that the Murchison Widefield Array (MWA) is at the center of the Universe. Australia is beautiful out here. The area is surprisingly green because of recent rains and the sunsets are a mix of pastel reds and blues. At night the sky is filled with shooting stars and the Milky Way cuts through the sky so bright that dust lanes and nebula, like the Cosack Nebula, seem to have been painted in black on top of the band of stars in our galactic plane. The radio sky as the MWA sees it would look very different. In order to grasp what the MWA does we will have to first explore what radio astronomy and interferometry is.
Radio astronomy is the alchemy of astronomy; shrouded by secrecy and perpeputated by false claims of being able to transmute raw data into gold. There was a time when radio astronomy was really hard, and that time is always, but technology is making new things possible. The Murchison Wide Field array that I am working on here in the outback is only one of the many next generation low frequency radio telescopes coming online or planned such as LOFAR, LWA, and others.

Modern astrophysicists can observe the Universe using light, particles, or (hopefully) gravity waves. Classically astronomers observed light through a telescope, but today we don't look through telescopes and we don't just vaguely see light; we precisley count photons from every part of the electromagnetic spectrum. Light is made of photons, but a photon can be thought of as a wave and a particle. Indeed, a photon is a wave and a particle at once. Longer wavelength photons have lower energy and lower frequency compared to short wavelength photons. In the radio regime of the electromagnetic spectrum the particle view of light is not very helpful, in fact many radio astronomers and engineers actually neglect to ever think about about photons and only consider wavelength or frequency. Radio astronomers view light as an electromagnetic waves impinging upon our patient antennas like waves on the beach.

Long wavelength photons come from some very interesting sources in the sky. Radio waves certainly come from the Sun, because the Sun emits some energy at just about every wavelength. Radio waves are also emitted by galaxies, pulsars, and neutral hydrogen (through the 21cm line). However, the wavelength of photons is not constant: it increases as the photons traverse the Universe due to cosmological redshift such that more distant objects are seen at progressively larger and larger wavelengths consider to more and more distant objects. In my research I am particularly interested in studying the distribution of matter in the Universe at the largest of scales and at the earliest epochs when there was an abundance of neutral hydrogen. Radio waves are perfect for studying these phenomena, but it is difficult to build a telescope that can see a widefield of view, can see a wide range of frequencies at once, and has good resolution.

As radio waves arrive at our antennas we can either immediately detect them or we can reflect them to a receiver. The Arecibo telescope in Puerto Rico is reflector type telescope, as are the antennas in the Very Large Array. The antenna on your car directly receives the electromagnetic wave because it induces an oscillation in the field inside the metal of the receiving antenna and then you can hook up a transistor, and a speaker - that is a radio like in your car.

The problem with detecting radio wavelengths is that they are not easy to catch and they act way too much like a wave. Waves have strange properties such as interference and diffraction. It can be shown from wave theory that a telescope of diameter D receiving light of wavelength λ has a fundamental angular resolution limit proportional to λ/D. For example the colossal 300 meter diameter Arecibo telescope can only resolve objects down to 3.5 arc minutes (or about half a degree) at a wavelength of .2 meters (or 1.4 Ghz) and that resolving power will only get worse as we move to longer wavelengths. So if you want to see small things in the sky you had better have a huge radio telescope. But wait, there is more. The field of view that a radio telescope can see is also proportional to λ/D. For example at a wavelength of .2 meters it would take Arecibo about 10 separate observations to make an image of the full moon which is about half a degree in the sky.

So if you want to look at the radio sky at high resolution you had better use a huge telescope, but if you want to look at the radio sky in huge swaths, like in survey, you had better use a small telescope. It would seem to be that we are at an impasse to find a decent resolution and decent field of view radio telescope. Enter radio interferometry.
The diagram above is a pictorial representation of the principles of radio interferometry. In box A we have a big radio dish like Arecibo and a radio wave incident upon it. The radio waves hit the dish and reflect to a receiver (not shown in the cartoon) at the focal point. In box B we have chopped our radio telescope into little bits and so while the dish would behave as a smaller dish it would operate via the same principles. Each part reflects the radio waves incident upon it to a single focal point. In box C we have moved the pieces of the dish into several independent dishes and wired them together. Each dish now has its own focus, field of view, and angular resolution limit (this setup is similar to the VLA). Finally, in box D we have gotten rid of even the dishes. Instead of turning the dish to point to a particular object we use the time delay due to the finite speed of light to 'point' the antennas. An object in the direction θ in the sky sends out radio waves that arrive at the antenna tilted. So to catch the same the wave on the antenna on the left and right spanning the arrow in the diagram we use the time delay τ. In this setup there is no pointing the dish there is only an electronic control of simple antenna elements; this is how the MWA works.

The most difficult part of pulling the telescope apart is reassembling the signals coherently. In the diagram this is the function of the box with the circle and x. In radio astronomy that box would be a complex supercomputer and is called a correlator. The computing power needed to operate a correlator scales as the number of antenna elements squared thus it really takes a powerful computer to operate an array with many antennas. The idea is that the signal from each pair of antennas is correlated together to determine the pattern of incident radio waves. This is the basic idea of radio interferometry; the beautiful thing is that you get the large field of view that each antenna would see and the excellent resolution that the large diameter of antennas provide. The description I have given here of radio interferometry is wildly simplified.
So here I am in a shed in Murchison. A generator is humming along and powering all our computers and equipment and importantly the air conditioner keeping me cool. Flies and strange insects pester us relentlessly the moment I step outside. There are a lot of great things about Australia, but it is also a very harsh environment out here. The array has not been cooperating perfectly: there are amplifiers, attenuators, analog to digital converters, correlators, and more that all have to act in symphony for the system to work. The last few days we have solved as many problems as we have created. The radio sky sends its nite rote down upon us and waits for us to complete the instrument.

Scratching the Surface

Perth, Australia - I found myself in a coffee shop in downtown Perth today just as I would likely of been in Seattle. It was as if I were in a parallel dimension and indeed I talked about parallel dimensions with some new friends I met. I asked them about places in Perth and they asked me about the Universe; I think I learned as much about Perth as they learned about the Universe.

I walked north towards a pub they recommended, but on the way I discovered something much more interesting. I stumbled upon the Scratching the Surface art show. It was a visual art gallery opening by several young artists just beginning to make they mark upon they world, or as they said just scratching the surface. I was walking along the street when I took a double take upon seeing book pages folded upon themselves in a mysterious manner. It was Pascal Proteau's work from recycled books. One of the most imposing works was a massive balance of books holding upon itself a crooked balance of folded book pages.
Nathan Brooker presented a series of works that were reminiscent of Andy Warhol in their repetition and bright colors. Some of his work was shocking. The image below is tame, but the Nathan did many more interesting things which cannot be shown (here is a seriously not safe for general consumption, very intense and shocking do not click here if you don't want to be offended image of Booker with art).
There was lots of shocking art including strange embroidery by Carla Adams. She used homely materials to create dangerous and daring works. I assure you that the image here is the most tame possible from the work she had on display. I asked her what had turned her mind to think of such juxtaposed concepts and she said that it was exactly that, the juxtaposition itself of feminine handy work and male homosexuality.
I was drawn in by the strange folding of books, but it was Ian Williams piece that really stole the show for me. He called it 'Under the Influence', but whatever the influence was it was inspired. An acrylic on oil board piece it was a work of labor as he told me it was painted with acrylic then sanded down then painted again. The entire piece had a subtle checkerboard texture pattern which resulted. And the eyes. The eyes followed the viewer from every angle. This piece was also amazingly large (1.8 by 1.2 meters) which added to its captivating features. It was a stunning piece. He is a talented artist.
Finally, here is a piece of art created just this evening by a friend who I know only as Silvia. She was an art student at the same school in Perth (CIT) as all the artists featured above. I went to a bar (with the aptly artistic name Ezra Pound) with her after the art show and she drew this for (or rather of) me.
It was a strange day in a strange place, but it was fantastic. Tomorrow, I head north into the desert and the Outback.