If you take a look at multitouch videos on Youtube, most of them are related to photo manipulation.These demo movies show the possibility of scaling, rotating and translating multiple photos at the same time.
A few days ago I created a small demo application called tDesk. tDesk is an experimental tool running on Windows XP which enables users with an FTIR multitouch screen to move and resize (multiple) applications with their bare hands.
(1) This movie shows how to move and scale dialogs in windows:
(2) This movie shows how to move multiple dialogs in windows:
Hmm you probably noticed it already in the movie, I kinda screwed up at the end of the movie.
Since my panel is not mounted on a frame it can move if you press with too much pressure… and that’s happened at the end.
* About the video clip played in movie 2, it’s Jamiroquai with Virtual Insanity. You might notice his whole environment is moving as well 😉 …
13 responses
Really interesting and nice to see that this type of research is also done here in Holland :). Personally, I would like to have a multi-touch sensor being integrated in the display screen for an otherwise conventional workstation setup: vertical screen(s), keyboard, mouse. I am not ready to give up my mouse and keyboard (yet) and they do fill my desk space along with papers and other junk I use in my daily work. For some tasks though, the new technology is clearly superior and I would love to be able to use it [i]as well[/i]. I think it is a mistake though, to think it is superior in all aspects and can replace the existing human interface devices. On screen keyboards for instance look nice in YouTube demo movies but are really awkward to use in reality. I hope I am not being offensive here ;)
This looks great! How did you manage to control the cursour in regular Windows apps? And is it possible for multiple users to manipulate windows at the same time? I have just started a similar project and have several ideas for multi touch combined with music software, so some info would be really appreciated. Thanks in advance, and cool blog by the way! Keep up the good work.
@Rasmus well the can only be manipulated with the mouse. It works kinda like the photo app, it needs 2 blobs to resize or move a window :) (its using the HWND handle in windows). So if both users would put one finger on the application, you should be able to manipulate it together… However I made this as a test application, since it doesn’t has a real purpose atm.
Thanks for your reply. Is it possible to see how you made your test application? I can think of several purposes for controlling normal windows applications with multi touch - for instance painting together in a photo app or multiple musicians playing on the same screen on plugins or music apps like ableton live. I’m trying to figure out how that can be done - software today are really contructed for single user/single cursor, but there most be a workaround. Maybe the Microsoft Windows MultiPoint Software Development Kit could be used?
Since windows XP doesnt supports ‘real’ multitouch it is not possible to paint together (which would require mouse hacks). I’ve seen the MS windows multipoint SDK but I’m not sure if thats the way to implent multitouch…
hi Laurence. how can I download the tdesk app so that i can test it too. :D thanks and more power!
is it possible to download tDesk and if so how? im currently working on my multitouch display. its 8’x4’ and doubles as a home entertainment center. i would like to be able to do more than just play around with the smoke app. thanks.
Well its just an early techdemo I made, its not very usefull ;)… It is not yet available as download (it is currently broken with the latest touchlib).
Hallo, I am using XP for DAW and want multi touch (atleast 2 points), Can I use an optical or infared touch screen already manufactured by elo, Planar, or an overlay, etc? to use with tDesk? Right now I have a 5 wire resistive form elo, will there be support for resistive 5 wire in the future? Thanks!
tDesk requires touchlib, as far as I know, commercial displays wont work with touchlib.
Yes but what if the commercial display is optical/infrared? I have touchlib, and tDesk. And I’ll ask again, will there be support for resistive touch screens with the mentioned software, (can it be done) a knowledgeable reply to both questions would be Greatly appreciated, I am sorta in a jam too, as I have an elo 5 wire resistive and am getting conflicting statements website to website whether multi touch is possible on it, (I Only need Two touch points), so I need to know these things to determine if I should keep it or sell it, to get an optical/infrared touchscreen. And worst of all I need this for DAW and I understand Resistive is most accurate for controlling sliders, buttons, etc, on soft synths and recording software, as the Neko from openlabs uses a elo resistive touch screen, and I do in fact find it to be pretty spot on. Is optical better for this? I really have a dilemma, and really need help. Thanks!! : ) !ERIK!
Hi, I orderd a 22’’ multitouch from iNexio today and was planning to use it with windows7, but to use multitouch like you shown in your demo on XP would also be bestg for me. The iNexio multitouch is based on IRTouch and will be treated as singletouch by XP as fr as i know. what kind of touch are you using (is it self made?). Will your application be able to use my iNexio touch?
@Hans Petter Its more a hack than actually adding multi-touch on OS/Driver level. I might create a TUIO version in future which should allow you to use tDesk on Win7.