Up to now, the focus has been on setting up the system and building the 3D environment. With this all baked in, the remaining posts will add all the components that make it into a complete system. These will discuss how to overlay 2D PyQt UI’s and how to connect the visualization via LCM to an real-world bot. A number of interesting points have also been raised by readers, so I’m including sections for installing on Windows, integrating camera real-world feeds, and using GLSL to build shaders in VTK.
The mainstream structure for the 2nd-half of this thread is:
- Part 4 – Adding a 2D UI with PyQt (technically called the non-diegetic components)
- Part 5 – Integrating communication channels with LCM
I am planning on including 3 additional sections that are not strictly part of the main thread, but are good questions or suggestions by readers (similar to the recent ‘Interlude’ post):
- Interlude 2 – How to set up a Windows environment for VTK, PyQt, and LCM (written by Daniel Gawryjolek and contributed by William Shipman)
- Coda 1 – Integrating Camera Feeds with LCM and OpenCV
- Coda 2 – Using GLSL for Shader-Level Processing (Ooorah Pixelshaders!)
Thanks for all the hits and the good feedback, it’s really appreciated. I hope you’re enjoying reading them as much as I’m enjoying writing them.