The Early History of the SVD

I recently read G.W. Stewart‘s little paper On the Early History of the Singular Value Decomposition (free tech report version is at UMD). It talks about how Beltrami, Jordan, Sylvester, Schmidt, and Weyl all had different approaches to finding/proving the SVD. It’s worth a quick skim, because goodness knows it appears everywhere under all sorts of names. Part of the problem is characterizing the SVD, and the other is calculating it. Since numerical analysis was never part of my training, I don’t have as much sophisticated appreciation for the algorithmic aspects, but I certainly benefit from having efficient solvers.

One point Stewart makes is that we really shouldn’t call the approximation theorem for the SVD the Eckart-Young Theorem, since Schmidt was really the one who showed it much earlier in the context of “integral equations, one of the hot topics of the first decades of our [the 20th] century.” I’ve been guilty of this in the past, so it’s time for me to make amends. I suppose I better start saying Cauchy-Bunyakovsky-Schwarz too.

What was weird to me is that as an (erstwhile?) signal processor, there was not much mention of the Karhunen–Loève transform, even in the little paragraphs on “principal components.”

Advertisements

Linkage

Links to videos and a special chair.

James Baldwin debates William F. Buckley, Jr. I’ve only seen part of it so far, but it’s pretty interesting (via Ta-Nehisi Coates).

I’ve heard quite a bit about the treatment of agricultural workers in Florida, particularly in tomato farming, but this video with a representative of the Coalition of Immokalee Workers is a good introduction to what is going on there (via Serious Eats). The book Tomatoland is on my reading list.

I didn’t know the origin of the term swizzle-stick until now.

I’m a big fan of Cowboy Bebop, and Shinichiro Watanabe has a new show out called Sakamichi no Apollon (via MeFi). I watched the first episode, and the Art Blakey album Moanin’ features prominently, so I think I’m going to like this show quite a bit. It’s being streamed in a ad-heavy format on Crunchyroll.

That’s a lot of pendulums. That’s right, pendulums.

Why don’t you relax a little in the bear chair?