lens finding

Marshall was in town and we tried to get some work done on our project to find strong lenses in ground-based imaging. We spent most of the time hacking around in legacy code. Foreman-Mackey showed us how to write a setup.py file in a Python module, which was very useful.

eclipse visualization

My only significant reportable research today was working on our GALEX eclipses, in particular the figures. Here's one:

MCMC for least-squares

Goodman came by with his student Bo Zhu to talk about a method for sampling in the special case that the logarithm of the likelihood is quadratic in a residual (like a chi-squared) and the priors on the parameters are Gaussian (or improperly flat and unbounded). They have a very clever method, inspired by Levenberg-Marquardt optimization, that makes use of the derivative of the model with respect to the parameters; their method perfectly (that is, with unit autocorrelation time) samples any linear least-squares problem straight out of the box. They asked me for problems (nails for their MCMC Hammer, if you will); we discussed a few but decided to start by testing it on problems on which we have run our ensemble sampler.

good attitude

I spent some of my travel time working on a suggestion for the Gaia pipeline teams: A pillar of the Gaia data analysis plan is a fully data-driven (that is, not physical) attitude model, set by the timings of the star transits. The model they plan on implementing is immense: It consists of a hundred million attitude pseudo-vectors on a grid of spline knots. I am proposing that the team set the freedom or complexity of this model objectively, using either cross-validation or a Bayesian mixture of different complexities. Either way, objective setting of the complexity should beat the team's plan of hard-set complexity; what I don't know is whether this will or can improve the results significantly enough to justify the work. I also suggest that they can tune the complexity in two different ways: They can either change the knot spacing or else tie together adjacent knots using a smoothness prior.

telnet protocol

[I am on family-related travel this week, so although I am working, it is not at full capacity, and I hereby assert The Rules.]

I got on the screen+skype pair-code tip with Lang for a couple of hours today to debug the part of our white-dwarf-eclipse project that queries the JPL Horizons system for the GALEX ephemeris. We need to contact the ephemeris because we have to translate the ingress and egress times for the eclipses into Solar System barycentric time. Think: Eight minutes from Earth to the Sun and all, plus additional aberration because of the spacecraft. It turned out that the problem was our negotiation with the telnet port (yes, we party like it's 1983 here at Astrometry.net headquarters) at JPL. We are using the standard Python telnetlib module, which doesn't hold your hands at all. That is, it requires us to construct all the "DO", "DON'T", "WILL", and "WONT" commands by hand. If you have no idea what I am talking about, thank your lucky stars! Suffice it to say that as we were working, it was sounding like we were hacking into NORAD for some War Games.

In the end, we succeeded, and it occurs to me that a Python module that wraps the telnetlib module and talks competently to the JPL Horizons system could be very, very valuable. Should we clean that up and push it to github? I am feeling all "code releasy" these days, with the huge positive community reaction we have got for emcee.

Dr. Berry Holl

I was the opponent today in the PhD defense of Berry Holl (Lund). As opponent, my role was to draw out the content of the thesis with questions and also subject the candidate to (extremely public) scientific scrutiny. It was great fun, in part because the thesis was so good, and in part because Holl handled the questions so well and so completely. His thesis has a lot of challenging linear algebra in its core (and I love linear algebra) but in the end I found myself spending most of my time on the 2/7 of his thesis that dealt with radiation damage to the Gaia CCDs. The question Holl answered is what that damage is likely to do to the data and to the precise measurement (and more importantly modeling) of the transit times of the stars. The conclusion we came to during the event is that the Gaia science data will actually contain more information about charge-transfer inefficiency and radiation damage than any other source of data before or during the mission. And that includes all the data that have been taken expressly for the purpose of learning about radiation damage!

Many Gaia projects have this character: The nasty systematic effect (general relativity in the Solar System, substellar companions, surface convection on giants) that matter at Gaia precision turn Gaia into the world's most sensitive measuring device for those effects. So in particular, at the end of the Gaia mission, we will have a great deal of precise quantitative knowledge about the behavior of CCDs that have been damaged; a great deal of precise knowledge about CCDs in general, really.

Holl passed his defense unanimously, of course, and it is with this post that I congratulate him and welcome him to the community of scholars!

three themes of data analysis

Melvyn Davies (Lund) upbraided me for not bringing a jacket and tie to Lund for tomorrow's PhD defense event, where I am a very important person. After he finished haranguing me about my jeans, we discussed the possibility of ever imaging or detecting directly free-floating planets. The conversation was discouraging!

I gave my seminar, and in preparing it I realized that there are a lot of simple themes connecting the crazy array of seemingly disconnected topics I work on. I was able even to classify my projects: Those that involve data-driven models (Tsalmantza quasar, Bovy quasar, and Fergus high-contrast projects); those that involve probabilistic classification or mixture models (Foreman-Mackey calibration, Lang Comet Holmes, and Koposov GD-1 projects); and those that involve moving away from catalogs and down towards rawer (pixel) data (Lang faint-motion and my own crazy large-scale structure projects). All this pleased me, because those are three ideas that can (in principle) be put into a one-hour seminar. I failed today, but it is a process, right?

By the way, one of the nicest conclusions of the Holl (Lund) thesis is that forward modeling is the best way to deal with Gaia's charge-transfer inefficiency issues. That's good for my brand.

inverting inverse covariance matrices

On my flight across the Atlantic I took photos from my seat which I today assembled into this video:

I also finished reading and making comments on Berry Holl's (Lund) PhD thesis. He has worked out expansions for inverting enormous Gaia-like inverse covariance matrices—inverse covariance matrices tend to be simple and sparse, covariance matrices tend to be complex and dense—and he has shown that Gaia can deliver on its promises despite the expected radiation damage to its CCDs. This radiation damage leads to charge transfer inefficiency, which leads to changes in the point-spread function in the scan (charge-transfer) direction on the CCDs. This leads to timing residuals which in principle affect astrometric measurements. However, the multiple scan angles at which Gaia hits each field saves it, even if the CTI is evolving with time and doesn't match exactly any of the (somewhat heuristic) models.

Holl impressed me 1.5 years ago and it will be an honor to play the (formal) role of opponent at his defense.

One thing I need to work out (for my own good) is how inverting the inverse covariance matrix relates to marginalization. The diagonal elements of the inverse covariance matrix are like the inverse uncertainty variances holding all other parameters fixed, whereas the diagonal elements of the covariance matrix are like the uncertainties marginalizing out all other parameters. That's all cool. But inverting the inverse covariance matrix is something any responsible frequentist must do; marginalization is only permitted for Bayesians. Do you see why I am confused? I am not confused about the math; I am confused about the meaning.

everything except the task at hand

Once again, Schiminovich and I were at our undisclosed location to work on GALEX time-domain projects. Instead we had a wide-ranging conversation about upcoming projects. We discussed the GALEX photon list project, and the kinds of things we will be able to do with a trillion time-tagged photons. We discussed joint NYU-Columbia advanced astrophysics lab courses that would have the students building and operating autonomous telescope hardware on NYC roofs. That project could beautifully combine teaching and research. We discussed what Popper calls verisimilitude: Are our well established models of the physical world literally true? Uh oh, weren't we supposed to be writing a paper? We discussed dispersed integral-field spectroscopy but also spatially dispersed to drop the background levels.

In the airport (on my way to Lund, Sweden) I had conversations with Foreman-Mackey about the arXiv and Lang about jobs.

gravitational lens modeling

Despite all my intentions to stop working on strong gravitational lensing, I keep getting accidentally pulled back, with interesting projects from Marshall and new discoveries from Tsalmantza. Today I pitched some strong lensing modeling projects to NYU graduate student Cato Sandford. The idea is to simultaneously model multi-epoch multi-band imaging (with variable PSF) with a time-varying multiply imaged quasar and the galaxy that is lensing it. That conversation is about the only real research I can report on today.

publishing implementations

Foreman-Mackey and I got very close today to finishing a note for arXiv on his super-fast, parallel, ensemble sampler that we have been using in a range of projects (see recent papers by Lang and Bovy). We will put it up as an arXiv-only paper, which is something I love to do. But the fact that this is not a typical or normal kind of publication—for example, there is nowhere that it could appear in the peer-reviewed literature—is crazy: A great implementation of a good algorithm that enables lots of science is itself an extremely important contribution to science, just like a telescope or a camera or a spectrograph. How can we make these things count like publications? And how can we change the language we all use that separates these contributions out into categories that are always contrasted with the category "science"? Enough spouting; watch the arXiv this week for some block-busting code.

[Note added a week later: Here is the arXiv paper.]

electromagnetism and massive stars

Inspired in part by our meetings yesterday about Fergus's modeling of imaging data in a coronograph, I worked on a physically motivated re-factor of my physically motivated code to model electromagnetic fields (phase and amplitude) in astronomical telescopes and cameras. I am just a few dozen lines of code away from having a full model (highly approximate) of a simple coronograph.

In the afternoon, Selma de Mink (STScI) gave a nice seminar about extremely massive star evolution. Among many other things, she noted that there is a possibility that low-metallicity, rapidly rotating, massive stars could evolve to very hot temperatures and very high luminosities where no other kinds of stars can be. I think we can find these things in PHAT data on Andromeda; I need to email the team.

exoplanets and speckles

Fergus did a set of demonstrations today for Oppenheimer, Brenner, and me of his planet-finding code for Oppenheimer's P1640 high dynamic-range imager. The imager blocks out most of the light of the star in an intermediate focal plane, but a combination of atmosphere and optical distortions plus physical optics means that still huge amounts of light hits the focal plane and in a very speckly pattern of blobs. Fergus showed us that he can (potentially) find planets among those speckles, even planets that are percent-level distortions of the speckle pattern! If this holds up it could have huge impact on high dynamic-range imaging, now and in the near future. For the past week or two I have also been playing around with modeling electromagnetic fields in imperfect cameras to see if we can make a more physically motivated model (Fergus's model is data-driven rather than physics-driven).

HST target selection

Tsalmantza and I discussed how we might winnow down our list of potentially lensed quasars into a set of sensible targets for HST imaging. It is essential to look for marginal evidence of extension; that is, do the quasars depart from our expectation of point-source morphology. A more speculative path is to look at luminosity indicators: Are any of the quasars brighter than you would expect given line strengths and ratios, possibly indicating gravitational magnification?

eclipsing binaries to population inference

Schiminovich and I returned to our undisclosed location today to work on the eclipsing white dwarfs we found in our GALEX time-stream project. We spent an inordinate amount of time working out how to infer the properties of all white-dwarf binary systems from a small number of discovered eclipsers. It is possible of course; the magic of a probabilistic generative model makes anything possible when selection and discovery can be modeled at least statistically, which it can (easily) in this case. In paper one, we are only going to do the most rough (order-of-magnitude) population inference, but eventually we should be able to say quite a bit. One consequence of our discussion was an increased optimism that we might have or get some companions that are substellar.