“Rhythm” Games and iPod Gaming Experiments
19th February 2007
About a year ago, I started thinking about what it would be like to play games using the iPod’s unique “clickwheel” interface. It seemed especially interesting because the Nintendo DS was proving unique game experiences were possible with a touch interface, along with games like Guitar Hero that were taking “rhythm games” mainstream. Apple must have thought it was a good idea too, because they started offering games in the iTunes store about 6 months later.
For my project, I modified a PC clone of the popular PSP rhythm/puzzle game Lumines to be controlled with the following trackpad, mimicking the iPod clickwheel in software:
The idea that you could play Lumines levels based around your own favorite songs was also something I wanted to explore. Microsoft later implemented this with their version of Lumines, featuring songs from artists like Madonna, now available in the XBox Live Arcade. There was a popular iPod commercial at the time featuring Eminem, so I also created a custom mod or “skin” using graphics from the commercial and looped sections of the audio from the song “Lose Yourself”. The current dropping piece could be moved left and right with counterclockwise/clockwise motion on the trackpad and rotated with pressure on the center “button”. The following is a video of my hacked up game composited within the iPod interface:
Most “rhythm” games work on the premise that the specific beats or melodies in a song statically determine when a player’s actions should occur, such as where to place your feet in DDR or the notes to play in Guitar Hero. However, it looks like there is lot of room for innovation in how players can inject their creativity into a game’s soundtrack. When thinking of how gameplay can change a game’s musical score, I’ve found that player actions usually fall into one of two categories:
1. Actions that Augment the music (as in Rez, where the player is remixing or composing new aspects of the music through gameplay)
2. Actions that Progress the music (as in Lumines or the upcoming SSX:Blur, where player achievements trigger progression in the musical score)
The second category is core to the Lumines game, which you can see in the video when big combos are scored, resulting in changes to the graphics and progression to the next looped section of the song. I experimented a bit with the first category by adding “DJ scratch” functionality, where scratch gestures on the trackpad triggered appropriate record scratching noises, which in theory would allow the player to add his/her own style to the song. It didn’t work too well in Lumines because the scratching motion would annoyingly cause the current dropping piece to move left and right, so I just ended up playing a random scratch noise when rotating the pieces.
It will be interesting to see how these ideas could be further developed into future iPod games. More details on this project (and hopefully other experiments) at my new gameplay prototypes project page.

March 28th, 2007 at 11:11 pm
I would say the original lumines falls more into the first category (music does get stuck in the first Lumines if you dont dissapear any block at all, but that doesnt happens often, and they even removed that feature in lumines II, the sound effects are much more dense than in the Lumixed version)
Please tell us where did you found that hacked version X3
August 6th, 2007 at 7:53 am
Movies and Much More !…
Unlimited PSP Downloads: Games, Music, Movies and Much More !…
September 7th, 2007 at 7:37 pm
Hi all!
This is a beautiful site. I`ll send the link to my friends.
Bye
October 20th, 2007 at 10:25 pm
psp music…
psp, psp games, psp downloads, psp music, psp movies, playstation portable…
May 31st, 2009 at 9:25 pm
After a long search through all the “waste of space” blogs, I finally find yours and am happy! Thanks for the informative read, and I look forward to more!
December 27th, 2009 at 6:26 pm
Great stuff, will bookmark this and add your RSS to my feeds.
April 6th, 2010 at 5:52 am
Consider & Preserve your iPad for Zero cost! -> http://bit.ly/cFBuis
June 13th, 2010 at 9:04 pm
Excellent write up, I will bookmark this post in my StumbleUpon account. Have a great day.