variational inference

Today was a great day of group meetings! At the stars group meeting, Stephen Feeney (Flatiron) showed us the Student t distribution, and showed how it can be used in a likelihood function (and with one additional parameter) to capture un-modeled outliers. Semyeong Oh (Princeton) updated us on the pair of stars she has found with identical space velocities but very different chemical abundances. And Joel Zinn (OSU) told us about new approaches to determining stellar parameters from light curves. This is something we discuss a lot at Camp Hogg,
so it is nice to see some progress!

We had the great idea to invite David Blei (Columbia) and Rajesh Ranganath (Princeton) to the Cosmology group meeting today. It was great! After long introductions around the (full) room, we gave the floor to Blei, who chose to tell us about the current landscape of variational methods for inference in large models with large data. His group has been doing lots there. The discussion he led also ranged over a great, wide range of things, including fundamental Bayesian basics, problem structure, and methods for deciding which range of inference methodologies might apply to your specific problem. The discussion was lively, and the whole event was another reminder that getting methodologists and astronomers into the same room is often game-changing. We have identified several projects to discuss more in depth for a possible collaboration.

[With this post, this blog just passed 2^11.5 posts. I realize that a fractional power of two is not that impressive, but it is going to be a long time to 2¹² and I'll be lucky to ever publish post number 2¹³!]

interdisciplinary inference meetings

Justin Alsing (Flatiron) organized an interdisciplinary meeting at Flatiron across astrophysics, biology, and computing, to discuss topics of mutual interest in inference or inverse problems. Most of the meeting was spent with us going around the room describing what kinds of problems we work on so as to find commonalities. Some interesting ideas: The neuroscientists said that not only do they have data analysis problems, they also want to understand how brains analyze data! Are there relationships there? Many people in the room from both biology and astronomy are in the “likelihood-free” regime: Lots of simulations, lots of data, no way to compare! That will become a theme, I predict. Many came to learn new techniques, and many came to learn what others are doing, so that suggests a format, going forward, in which we do a mix of tutorials, problem statements, and demonstrations of results. We kicked it off with Lauren Anderson (Flatiron) describing parallaxes and photometric parallaxes. [If you are in the NYC area and want to join us for future meetings, drop me a line.]

measuring the velocity of a star

Yesterday and today I wrote code. This is a much rarer activity than I would like! I wrote code to test different methods for measuring the centroid of an absorption line in a stellar spectrum, with applications to extreme precision radial-velocity experiments. After some crazy starts and stops, I was able to strongly confirm my strong expectation: Cross-correlation with a realistic template is far better for measuring radial velocities than cross-correlation with a bad template (especially a binary mask). I am working out the full complement of experiments I want to do. I am convinced that there is a (very boring) paper to be written.

what is math? interpolation of imaging

The research highlight of the day was a long call with Dustin Lang (Toronto) to discuss about interpolation, centroiding, and (crazily) lexicographic ordering. The latter is part of a project I want to do to understand how to search in a controlled way for useful statistics or informative anomalies in cosmological data. He found it amusing that my request of mathematicians for a lexicographic ordering of statistical operations was met with the reaction “that's not math, that's philosophy”.

On centroiding and interpolation: It looks like Lang is finding (perhaps not surprisingly) that standard interpolators (the much-used approximations to sinc-interpolation) in astronomy very slightly distort the point-spread function in imaging, and that distortion is a function of sub-pixel shift. He is working on making better interpolators, but both he and I are concerned about reinventing wheels. Some of the things he is worried about will affect spectroscopy as well as imaging, and, since EPRV projects are trying to do things at the 1/1000 pixel level, it might really, really matter.

chemical correlates of planet system architecture

At Stars group meeting, Jo Bovy (Toronto) demonstrated to us that the red-giant branch in Gaia DR1 TGAS is populated about how you would expect from a simple star-formation history and stellar evolution tracks. This was surprising to me: The red clump is extremely prominent. This project involved building an approximate selection function for TGAS, which he has done, and released open-source!

John Brewer (Yale) showed relationships he has found between planet-system architectures and stellar chemical abundances. He cleverly designed complete samples of different kinds of planetary systems to make comparisons on a reasonable basis. He doesn't have a causal explanation or causal inference of what he is finding. But there are some very strong covariances of chemical-abundance ratios with system architectures. This makes me more excited than ever to come up with some kind of general description or parameterization of a bound few-body system that is good for inference.

I spent the afternoon at CIS 303, a middle school in the Bronx, as part of their Career and College Day. This is an opportunity for middle schoolers to discuss with people with a huge range of careers and backgrounds what they do and how they got there. So much fun. I also ran into Michael Blanton (NYU) at the event!

mentoring and noise

Today I was only able to spend a small amount of time at a really valuable (and nicely structured) mentoring workshop run by Saavik Ford and CUNY faculty. The rest of the day I sprinted on my Exoplanet Research Program proposal, in which I am writing about terms in the extreme precision radial-velocity noise budget!

quasi-periodic solar flares; TESS

In the morning, Daniela Huppenkothen (NYU) and I discussed Solar flares and other time-variable stellar phenomena with Chris Ick (NYU). He is going to help us take a more principled probabilistic approach to the question of whether flares contain quasi-periodic oscillations. He is headed off to learn about Gaussian Processes.

Armin Rest (STScI) was around today; he discussed image differencing with Dun Wang (NYU). After their discussions, we decided to make Wang's code easily installable, and get Rest to install and run it. Rest wants to have various image-differencing or transient-discovery pipelines running on the TESS data in real time (or as real as possible), and this could form the core of that. Excited!

exploding white dwarfs

Abi Polin (Berkeley) came through NYU this week. Today she delivered a great seminar on explosions of white dwarfs. She is looking at different ignition mechanisms, and trying to predict the resulting supernovae spectra and light curves. This modeling requires a huge range of physics, including gastrophysics, nuclear reaction networks, and photospheres (both for absorption and emission lines). The current models have serious limitations (like one-d, which she intends to fix during her PhD), but they strongly suggest that type Ia supernovae (the ones that are created by white-dwarf explosions) do seem to come from a narrow mass range in white-dwarf mass. If you go too high in mass, you over-produce nickel. If you go too low in mass, you under-produce nickel and get way under-luminous. In addition to the NYU CCPP crew, Surabh Jha (Rutgers) and Armin Rest (STScI) were in the audience, so this talk was followed by a lively lunch! Jha suggested that the narrow mass range implied by the talk could also help with understanding the standard-candle-ness of these explosions.

epoch of reionization

I had the realization that I can reduce my concerns about radial-velocity fitting (given a spectrum) to the problem of centroiding a single spectral line, and then scale up using information theory. So there is a paper to write! I sketched an abstract.

In the morning, Andrei Mesinger (SNS) gave a talk about the epoch of reionization. He argued fairly convincingly that, between Planck, Lyman-alpha emission from very high-redshift quasars and galaxies, and the growth of dark-matter structure, the epoch of reionization is pretty well constrained now, around redshift of 7 to 8. The principal observation (from my perspective) is that the optical depth to the surface of last scattering is close to the minimum possible value (given what we know out to redshifts of 5 or 6). He discussed also what we will learn from 21-cm projects, and—like Colin Hill a few weeks ago—is looking for the right statistics. I really have to start a project that finds decisive (and symmetry-constrained) summary statistics, given simulations!

Nice; counter-rotating disks

At Stars group meeting, Keith Hawkins (Columbia) summarized the Nice meeting on Gaia. Some Gaia Sprint and Camp Hogg results were highlighted there in Anthony Brown's talk, apparently. There were results on Gaia accuracy of interest to us (and testable by us), and also things about the velocity distribution in the Galaxy halo.

Tjitske Starkenburg (Flatiron) talked about counter-rotating components in disk galaxies: She would like to find observational signatures that can be found in both simulations and also the data. But she also wants to understand their origins in the simulations. Interestingly she finds many different detailed formation histories that can lead to counter-rotating components. That is consistent with their high frequency in the observed samples.

falsifying results by philosophical argument

I finally got some writing done today, in the Anderson paper on the empirical, deconvolved color-magnitude diagram. We are very explicitly structuring the paper around the assumptions, and each of the assumptions has a name. This is part of my grand plan to develop a good, repeatable, useful, and informative structure for a data-analysis paper.

I missed a talk last week by Andrew Pontzen (UCL), so I found him today and discussed matters of common interest. It was a wide-ranging conversation but two highlight were the following: We discussed causality or causal explanations in a deterministic-simulation setting. How could it be said that “mergers cause star bursts”? If everything is deterministic, isn't it equally true that star bursts cause mergers? One question is the importance of time or time ordering (or really light-cone ordering). For the statisticians who think about causality this doesn't enter explicitly. I think that some causal statements in galaxy evolution are wrong on philosophical grounds but we decided that maybe there is a way to save causality provided that we always refer to the initial conditions (kinematic state) on a prior light cone. Oddly, in a deterministic universe, causal explanations are mixed up with free will and subjective knowledge questions.

Another thing we discussed is a very neat trick he figured out to reduce cosmic variance in simulations of the Universe: Whenever you simulate from some initial conditions, also simulate from the negative of those initial conditions (all phases rotated by 180 degrees, or all over-densities turned to under, or whatever). The average of these two simulations will cancel out some non-trivial terms in the cosmic variance!

The day ended with a long call with Megan Bedell (Chicago), going over my full list of noise sources in extreme precision radial-velocity data (think: finding and characterizing exoplanets). She confirmed everything in my list, added a few new things, and gave me keywords and references. I think a clear picture is emerging of how we should attack (what NASA engineers call) the tall poles. However, it is not clear that the picture will get set down on paper in time for the Exoplanet Research Program funding call!

exoplanets

Today not much! I had a valuable conversation with Trisha Hinners (NG Next) about machine-learning projects with the Kepler data, and I did some pen-and-paper writing and planning for my proposal on exoplanet-related extreme precision radial-velocity measurements.

vertical action is a clock

Ruth Angus (Columbia) and I discussed the state of her hierarchical Bayesian model to self-calibrate a range of stellar age indicators. Bugs are fixed and it appears to be working. We discussed the structure of a Gibbs sampler for the problem. We reviewed work Angus and also Melissa Ness (MPIA) did at the 2016 NYC Gaia Sprint on vertical action dispersion as a function of stellar age. Beautiful results! We had an epiphany and decided that we have to publish these results, without waiting for the Bayesian inference to be complete. That is, we should publish a simple empirical paper based on TGAS, proposing the general point that vertical action provides a clock with very good properties: It is not precise, but it is potentially very accurate, because it is very agnostic about what kind of star it is is timing.

cosmological anomalies

I had lunch with Jesse Muir (Michigan), and then she gave an informal seminar after lunch. She has been working on a number of things in cosmological measurement. One highlight is an investigation of the anomalies (strange statistical outliers or badly fit aspects) in the CMB: She has asked how they are related, and whether they are really independent. I discussed with her the possibility that we might be able to somehow lexicographically order all possible anomalies and then search for them in an ordered way, keeping track of all possible measurements and their outcomes, as a function of position in the ordering. The reason I am interested in this is because some of the anomalies are “odd enough” that I would expect them to come up pretty late in any ordering. That makes them not-that-anomalous! This somehow connects to p-values and p-hacking and so on. I also discussed with Muir the possibility of looking for anomalies in the large-scale structure. This should be an even richer playground.

BHs in GCs, and a new job

In Stars group meeting, Ruth Angus (Columbia) showed her catalog of rotation periods in the Kepler and K2 fields. She has a huge number! We discussed visualizations of these that would be convincing and also possibly create new scientific leads.

Also in Stars group meeting, Arash Bahramian (MSU) spoke about black holes in globular clusters. He discussed how they use simultaneous radio and X-ray observations to separate the BHs from neutron stars: Radio reveals jet energy and X-ray reveals accretion energy, which (empirically) are different for BHs and NSs. However, in terms of making a data-driven model, the only situations in which you are confident that something is a NS is when you see X-ray bursts (because: surface effect) and the only situations in which you are confident that something is a BH is when you can see a dynamical mass substantially greater than 1.4 Solar masses (because: equation of state). He highlighted some oddities around the cluster Terzan 5, which is the globular cluster with the largest number of X-ray sources, and also an extremely high density and inferred stellar collision rate. This was followed by much discussion of relationships between collision rate and other cluster properties, and also some discussion of some individual x-ray sources.

[In non-research news: Today I became an employee of the Flatiron Institute, as a new group leader within the CCA! Prior to today I was only in a consulting role.]