I’ve been experimenting with using TWO as a timeline OSC record/edit/playback tool for Resolume, and have come quite a long way, but I’ve realized that by default, Resolume does not react well to having all the data it transmits being sent back from TWO verbatim.
Some messages are not meant to be received at the density they are sent. Others overlap, and while all are sent, only one should be received, etc.
I would love it if you wanted to test things out, to figure out what of the Resolume data should be filtered out in TWO and/or Resolume, so that they can work in unison!
I’ve put together a little video for this post, which you may find a good intro:
What you’ll be able to do with Resolume & TWO
Save states for Resolume, and interpolate between saved states.
Sequence these state changes on a timeline.
Record all the OSC data that Resolume transmits, thus capturing a performance.
Editing and playing back that performance.
Sequencing changes of parameters in detail in TWO’s timeline. In interaction with the recorded performance data.
A combined set of features which are very timely with the video recording feature just introduced in Resolume!
Recording and playing back a performance with Resolume and TWO
Resolume has a rich OSC implementation, with the characteristic that it transmits all state, with the same namespaces that it reacts to. This is useful in combination with the automatic namespace building of TWO.
The below steps are as far as I have come, but are not a complete tutorial on making the TWO & Resolume integration work – for that I need your tips on what Resolume likes and doesn’t like to receive!
Of course as we learn the steps below will be updated to reflect the best way to go. Once the integration is finished, I’ll upload a finalized file and make a nice tutorial to go with it.
In Resolume :
In ->Preferences->OSC, ensure OSC Input and Output are both enabled.
Create an OSC Network Location, setting the ports and IP’s to match the ones Resolume transmits to and from. Name it “Resolume”.
In TWO’s Global Settings View, ensure the option ‘Global – Build Namespaces’ Is enabled.
Already, you can record and edit the resolume data, just as in the oscHook example video. As you go, the namespace will be updated to reflect the data received.
But, unlike oscHook, Resolume has a huge, complex namespace.
To instead achieve detailed control, and do extensive editing of a Resolume performance, you need to split the huge global Resolume namespace, into sub-namespaces, each corresponding to a sub-section of Resolume.
Above you see TWO with one huge OSC Namespace for Resolume. Below, the alternative, of separating the above to many dedicated sub-namespaces, used in an “Address” hierarchy in TWO.
Load the composition in Resolume anew – this causes it to broadcast all of its OSC namespace.
The Namespace hierarchy appearing is as follows:
/composition/columns/n (1 – 9)
/composition/layers/n (1 – 3)
There are at least 3 sub-classes of namespace for Resolume: For columns, Layers, and within those, Clips.
It is straight-forward to adapt to this hierarchy in TWO:
In the Namespaces view, expand the Resolume_auto namespace to show /composition/columns/1.
(You can if you like rename “Resolume_auto” to just “Resolume”).
Right click the Node with pattern “/composition/columns/1”, and select “cut”.
Collapse the “Resolume” tree.
Right-click on the empty area in the Namespaces pane, and select “Paste”.
Select the newly created Root Node, and rename it from “1” to “Column”.
Ensure that in the Property Panel of if, the option “Build Namespace Automatically” is on.
Delete the Node hierarchy /composition/columns within “Resolume”.
Repeat the above steps for “/composition/layers/1”, naming the resulting namespace “Layer”, and deleting “composition/layers” within “Resolume”.
From within the “Layer” you just created, repeat the process for “/clips/1”, creating “Clip”, and deleting the “clips” hierarchy under “Layer”.
Now, switch to the Scene view, and create a hierarchy of sub-addresser under the “Resolume” Address, as below:
Column1 – Column9
Address Resolume should have Namespace Resolume. Layer1 and selectedLayer should have Namespace Layer. Clip1 through Clip9, and selectedClip, should have Namespace Clip. Column1 through Column9, namespace Column. Composition, Layers, Clips, Columns, should all not have a Namespace assigned at all, they only serve for grouping.
Right click on Layer1, select copy, then right click on Layers, and select paste. Repeat for the rest.
You now have a complete hierarchy you can reuse!
In TWO’s Live view, create a new Global Editor controller – you will see a column with controls for each Resolume sub-address, giving you a neat overview of all OSC parameters.
Depending on how you’ve set up Resolume’s OSC transmission, and how you intend to use it, you may wish to make these additional settings:
Mute input and output on selectedClip, and selectedLayer – since they duplicate what happens in the respective clips and layers in the hierarchy.
Potentially, also mute “/position” in namespace Layer, and “/transport/position” in Clip. Depending on how you use TWO with Resolume, you may or may not want these to be recorded/transmitted.
And, if at any time Resolume transmits a message which is not yet part of any namespace, TWO will automatically create a node for it in the most appropriate namespace from the ones you created, so no message is ever lost.
Save this file, as it will be your starting point for any new project you do with Resolume: this setup needs to be done only once, and given a completed file, you can just download it and use it without going through the above effort every time.
Finally, to add timelines for recording:
In TWO’s Timeline view, click “Create”, and in the appearing pop-up, select “Resolume”, and then click the “Recursive” button. That will add lanes for all addresses. You will see lanes created for all Addresses which have a Namespace assigned, ready to arm, and record clips into, separately!
If you do not want all, you can just add lanes separately for each Address tree separately – for example only the Layers hierarchy.
That is all for now, I hope you find this promising, and look forward to when Resolume and TWO integrate well together!
Since the first Alpha release, I have been very busy adding features and fixing bugs, making this version 0.9.3 a much more mature build!
The changes are very extensive, but here’s a summary of the most important improvements made:
• An entirely new Timeline Sequencer, for arranging saved states over time, and sequencing the gradual interpolation between them.
For now this sequencer has a single lane for states. In upcoming releases, Record, Playback and Re-Arranging functionality will be integrated into additional sequencer lanes (these are the lanes seen at the bottom of the image below).
Cut/Copy/Paste/Duplicate implemented for all elements where this makes sense.
• Many improvements to the GUI. New Icons, and several usability improvements.
• Extensive bug-fixes throughout. Most importantly:
– Global settings are now correctly stored and recalled on Windows 8 & 10.
– Several bug-fixes and improvements were made to Recorder.
– The rare occasional crashing should now have been fully fixed.
– The Envelope controller now works correctly across operating systems.
Existing installs can be updated using the “File->Check for Updates…” menu item.
Please keep the bug-reports and feature requests coming, and in the meanwhile I will concentrate efforts to finish the development of the timeline sequencer features, which upon completion will mark the 1.0 version of TWO.
For as long as it is in Alpha, TWO will be free to use. I hope that you find it to be a compelling tool!
In return, please share your bug reports, feedback and suggestions, on the TWO forum: www.thewizardofosc.com/forum/
Finally, after years in development, The Wizard of OSC (TWO) is ready for a first public Alpha release! Version 0.9.2 Alpha is coming up, for Windows and OS X.
TWO provides a set of tools which together allow the recording, replaying, and creative manipulation of digital media control signals (currently MIDI & Open Sound Control), be it for live sound, graphics, show control, or the Internet of Things. Its functionality is inspired by how live electronic musicians perform using a mixing desk and effects.
Along with the Alpha, I have also created a small independent program that serves as a self-sufficient example of TWO in use, accompanied with a video explanation, as well as a manual explaining TWO’s purpose and features.
For as long as it is in Alpha, TWO will be free to try and use. I hope that you find it to be a compelling tool!
In return, I hope you share your bug reports, feedback and suggestions, on the TWO forum.
I intend to iteratively improve on TWO, following your feedback, towards creating a rich, stable, final version for v1.0 release!
The following video serves as a brief introduction to TWO:
To accompany the release, here is a video detailing the AudioVisualBach demo program, available in the TWO Alpha download installation file:
So, head over to the Downloads page to grab the installer, for Windows and OS X!
I was recently involved in a project with the Agalma Foundation, in which two pianists improvise live, and data from their playing and electrophysiology, is used to control live visual music projections.
I was tasked with all software development for the live visuals, and The Wizard of OSC has played an indispensable part in connecting the vast data streams stemming from the performance to the live visuals projections. For the visuals, I used my open-source software Mother.
You will see me behind the desk full of electronics, and can also catch a glimpse of a prototype version of The Wizard of OSC running on a touch-screen laptop.
If you want to read more about the project with the Agalma Foundation, the Musica reportage goes into a bit more detail than this post.