When a transient bug is found in tests the good citizen thing to do is classify the failure and add a bug signature.

The ironic blueprint for ceilometer data is here. Etherpad with notes. And info on ironic+devstack.

There's javelin2 stuff in progress. Javelin are the tests done in grenade to validate instances across and upgrade. 2 is a new way to make them happen that is supposed to work. Apparently the earlier style did not.

There's a vagrant openstack provider which could be interesting.

I'm not a fan of regex-based parsing.