Art & Technology - Game Controller

I really enjoyed the game controller project we did.  It came easier for me to create more than the game, perhaps because of our previous experience with Makey Makey.  I did like how the game controller and game brought our Scratch, sound, programming, animated gif and Makey Makey projects all together to work cohesively as one thing.  For my controller, I chose to create a spherical ball reminiscent of the crystal ball that the Goblin King uses throughout the Labyrinth movie, and the one that Sarah is trapped in during the ballroom scene.  I used an old clear plastic ornament, and attached metal clips to it as the "buttons." Inside, I used a phone wire with 4 small wires inside to attach to the Makey Makey for my four controls in the game - up, right, left and the space bar.  I wanted to be able to use the controller in one hand (my second hand use in the video is only to steady it).  I painted it white to conceal the wires inside as well. 

The game creation itself came together in the end, even though it was more simple than I originally intended, and it was interesting to play it with the controller because it added an element of difficulty.  I made the controller to fit my hand too, so it also has an element of customization and uniqueness to it that I wasn't expecting for some reason.  It definitely adds to the artistic quality of the game, to have a one of a kind controller. 

As art teacher, I look forward to incorporating multiple artistic techniques into single projects.  I feel like this adds an element of dynamic learning that helps students realize their strengths and overcome their challenges. Working on large scale projects like this collaboratively would also be a great way to teach about teamwork and getting along with peers.  Although I think technology can be combined with traditional art making practices, projects like these completely redefine the way we can teach in an art classroom.  It truly combines many disciplines, and is aligned with STEAM curriculum.  I look forward to using new media in my classroom in the future.  

Art & Technology - Scratch Video Game

The project I found to be most difficult in my art and technology class was the video game made with the online program Scratch.  Not having any experience with video game coding, it was a lot of trial and error.  I also feel that I bit off a little more than I could chew at first with my video game plan.  Originally, I wanted to make a platform game similar to Super Mario Bros. but with the characters and theme from the movie Labyrinth (1987).  However, I came to realize that although the code blocks in Scratch are easy enough to put together, the more complicated the game gets, the amount of code you need grows exponentially.  With our time limits in the class, I was not able to get all of the features I wanted in my game, however, I did end up with a simplified version which I will post below. But first - a little background...

For those of you who haven't seen the movie, Labyrinth is an 1987 children's movie made by the dynamic duo of Jim Henson and George Lucas.  It is a fantasy story of a young girl who is forced to babysit her baby brother, and wishes for goblins to come kidnap him.  She doesn't truly think it will actually happen, but when it does, she realizes her mistake and goes on a quest through a giant maze to where her baby brother is being held - the castle of the Goblin King.  Throughout the movie she makes friends and defeats goblins and overcomes tricks played on her by the Goblin King, who is trying to stop her the whole time. It is similar to the story in the Wizard of Oz.  However, one scene she gets trapped in a bubble that is actually a magical ballroom, where the Goblin King is trying to distract her with fancy costumes and dancing.  At the end of the scene, Sarah remembers her brother and throws a chair through the bubble wall, and breaks it to free herself and continue the quest.  My game is based on this scene.

One of my favorite things about the movie Labyrinth is the feminist theme running through it.  The hero of the story is a girl, she overcomes a male authority figure by saying "You have no power over me" and gains self confidence and maturity and friendship.  She isn't won over by some handsome prince and she doesn't need to be "rescued."  At the beginning and end of the movie, the Goblin King transforms into a white owl, which classically is the symbol for wisdom, patience, secrets, mystery and observance, all of which are running themes through the movie.  Wisdom is her final prize in the end.

My game ended up as a single screen game, where the goblins come to dance with Sarah, which she defeats by hurling chairs at them.  Then, the Goblin King appears and throws hearts at Sarah, which stun her from moving.  She has to simultaneously throw chairs at a few cracks in the wall (look like lightning bolts), before the time runs out.  At the end, the Goblin King turns into the white owl and asks Sarah to obey him, but she responds with her signature line.  There are a couple glitches in the game, which I left in for now as an homage to glitches in general, and also because I have yet to figure out how to debug them!  I found the game to be a bit more enjoyable and challenging while using my controller for it, but I hope to go back in and make changes and updates as I investigate further into the Scratch program.

My frustrations were a lesson for me as a student, but also as a future art teacher.  I realized that my issues I had may be ones that my students have some day with lessons like these or other art and/or technology media, and the fact that I can say "I was frustrated at first too" is one of the best ways I feel to reach someone that you are trying to teach.  As a program, Scratch is great way to see how video games are created through simplified code, but also to see how they are much more complex than one might think.  They are a lesson in patience, creativity, problem solving and the ability to adapt and be flexible.  All of these traits you would find in a traditional art classroom, but combining them with a new technology greatly modifies how these lessons are taught.

Screenshot of my game with some of the code in Scratch. If not working visit https://scratch.mit.edu/projects/221756998/

Art & Technology - Thoughts on Body Movement and Engagement in Digital Game Play

"Edutainment, for example, stands to benefit from methods aiming to support and facilitate task related movements in the user" (Bianchi-Bertouze, et al., 2007).

In the article "Does body movement engage you more in digital game play? And Why?" by Nadia Bianchi-Bertouze, Whan Woong Kim and Darshak Patel, the authors conclude that

"body movements appear not only to increase the players’ level of engagement but also to modify the way they get engaged. The combined results demonstrate in fact that the controller itself plays a critical role in creating a more complete experience." (2007)

I have played several video games in the past, including ones that use non-traditional controllers, such as the guitars in the game "Guitar Hero."  Although I can't speak to the nuances of the level of my engagement in every video game I've ever played, I can say with certainty I definitely felt like more of a rock star while holding the pseudo instrument, more than I may have felt like a plumber jumping over pipes in Super Mario Brothers.  This immersion in games has been even furthered by the advent of Virtual Reality, where the visual and audio is part of the game, as well as the operations of the hands and feet, as the games often react to where you are reaching or the hand movements you make. 

However, when I think of the what children use today for entertainment on a daily basis and for much of the day, even in school, it is not a video game console that is dedicated and has specialized controls.  It is the mobile tablets and phones that have games and videos that they can take anywhere and interact with on a more intimate level.  Although there are stylus pens that can be used with these devices, most of the game play is with touch of a finger or two.  The "educational" games work in much the same way, and focus less on physical tasks and more on academic or thinking tasks.  I don't know what the future holds, but for now there seems to be a burgeoning disconnect between what the children are playing on and how it teaches them to complete real world practices. Not that Guitar Hero taught me how to play guitar, but it was closer than pressing a button on a screen.

My professor, Nicholas Leonard brought up an interesting point - are the physical tasks we are asking children to learn going to even be necessary in the future? (Leonard, Personal Communication, 2018).  Are we perpetuating an old stereotype that in order to live a full life, we must be able to engage with it on a concrete, physical level, or can we live completely with minimal effort from our bodies?  That is something that I think will continue to be a subject of debate as we advance more into the technological future, and things will become easier and easier.  Will our bodies evolve to adapt to these changes?  Will the inevitable failure of our technologies (because we all know how unreliable technology can be) be the downfall of our humanity if we grow too dependent on it?  Being a person born in the 1970's, I have lived through a time where cell phones as they are today did not exist, and now practically everyone has one.  I am starting to forget a time that there were no cell phones, and feel like I can't function properly if I do not have my phone on me.  Are we perhaps becoming integrated with our technologies and will there ever be a step back?

Those ideas are big ones, but can definitely be addressed in a classroom of artists.  They can make up their own ideas on what the future holds, and critically examine our lives today and in the past.  How we interact with each other and our bodies and minds seem to be an afterthought as technology takes over.  The students can then redefine their own curriculum and their own lives, based on what they would like their future to look like.

Art & Technology - GIF Animation using Piskelapp.com

For one of our projects in our art and technology course, we created animated GIF using using Piskelapp.com.  I found the process to be fairly easy to create and edit, having no previous experience creating pixel art nor animations.  I based my image on the character of "Sarah" from my favorite movie Labyrinth.  She is "walking" in her ballgown she wears in one of the scenes.  Her hair sways back and forth as she steps, and the "sequins" on her dress change with her movements as if shining in the light.  I found this very similar to stop motion animation, but with a digital twist.  I feel that my future students would really enjoy this simple to use program, and it would teach them the basics of animation with a vintage flair, since it is reminiscent of the pixel animations used in old video games such as Super Mario Bros.  It modifies the traditional animation practices of pencil and paper or claymation by adding in the computer element.

Art & Technology - Video Game Song "As the World Falls Down" by David Bowie

For this project, I made a soundtrack to my soon-to-be created video game "As the World Falls Down," which is inspired by the scene in the movie Labyrinth when the main character, Sarah, gets caught inside a crystal bubble ballroom world created by her nemesis, the Goblin King, as a way to stop her from completing her mission through the Labyrinth.  The music is based on the song by David Bowie, which was composed for the movie.  I used the sheet music from the song, along with sound bites created on Pulseboy.com.  I then looped the sounds and composed the song using Soundtrap.com.  On Soundtrap, I was able to slow down, speed up and piece together each separate part, to create a 2 minute and 26 second musical number. 

Using these technologies to create a soundtrack was easy and fun to do.  Programs like Pulseboy and Soundtrap are a great way to augment sound making and recording. I am not a musician, but I was able to use my limited musical knowledge to translate and modify the song into a semi-original piece.  I think that this type of composing would be beneficial in a classroom setting, especially among those who have never written a song before.  It was kind of like taking building blocks and placing them one at a time to form one larger thing, which was way less intimidating than actually setting out to write a full song all at once.  Being able to copy a tune also allowed me to learn more about music writing and composition, which I could use in the future to create a more original song.  Although I don't think copying is always the best thing to do, I feel that sometimes it can help teach how things are created by breaking it up into parts and reassembling it. 

Art & Technology - Thoughts on 8 Bit Video Game Audio, Then and Now

I grew up in the 80's and played video games (or watched my older brother play them) as far back as I can remember. Although I don't always remember every nuance of graphics or gameplay, the songs that accompanied the games I played are always recognizable and ingrained on my memory.  Back in the 80's, the limits of technology (or at the time, they were seen as advances), added a certain aesthetic to the music of video games that puts it unmistakably in the decade of decadence, where everything felt like it was from the future or "in the now."  That aesthetic translated into very memorable music, and those tunes are ones I hum even to this day.  Super Mario Brothers, Mike Tyson's Punch Out, Paperboy, among others, were all part of my daily routine.  The music was simple, yet usually held a driving beat that kept me motivated to play the games over and over and over, speeding up when the time was running out, getting more mysterious as I entered an underground level, or illustrating that my foe was from a different country than the one before. 

All of the songs were used to augment my experience with playing the games, make them stick in my memory and motivate me to play them multiple times.   The one similar aspect of all of the soundtracks was the use of looping to create short bursts of sounds into longer melodies.  Not only did this mimic how popular music was made at the time, it also created auditory cues for how I experienced  the gameplay.  For example, the short victory tune at the end of a Mario level, when he jumps on the flag and enters the castle.  This always gave me an almost Pavlovian response of relief and joy, as if I had been holding my breath while playing and could now relax. Or when the timer came to less than 100 seconds, the music speeds up to warn the player that they need to go faster.  Gameplay doesn't speed up, but the automatic response is to run and jump over obstacles and enemies much faster.

"It would appear, then, that rather than being the consequence of the limited memory available on the systems, loops were, at least in part, an aesthetic that grew as the games became more popular and more complex." (Collins, 2007)

Nowadays, students are still playing the "retro" games of the 80's and experiencing it as a sort of nostalgic aesthetic, rather than a futuristic or current one.  Even though music soundtracks on games have greatly surpassed the level they once were, there is still a fondness for the way things used to be.  In that, we can teach students that often when technology becomes "obsolete", it can be used in a new way or how we can use it to modify or redefine what we already do, rather than lost and forgotten.  Appreciation of older technology can create that greater respect for the way things are now.

Reference

Collins, K. (2007). In the Loop: Creativity and Constraint in 8-bit Video Game Audio. Cambridge University Press.

Art & Technology - Fart Machine (Fun AND Educational!)

After creating our fart sounds, I decided to augment our project into a fart machine.  To keep things semi-appropriate, I chose to create a line of "poop emoji" rubber ducks that each represented one of the sounds we made.  To create the soundtrack, I loaded the sounds into Scratch (scratch.mit.edu), and hooked up the Makey Makey to the computer and set each corresponding computer key to each of one of the sounds.  For example, the space bar is hooked to the "FartSound.wav."  When the space bar (or the Makey Makey wire) is clicked, the corresponding sound plays from the computer.  Since the ducks are rubber, I need to attach a metal piece to them to complete the circuit, since rubber does not conduct electricity.  I used brads that were poked into the side of the ducks and stuck out the bottom, where the Makey Makey wires were hooked.  The result was the perfect little fart machine.  

Although my kids and I had a lot of fun making this, I felt it really augmented our sound making learning experience.  We got to see how the Makey Makey works, and create a "machine" that allowed us to display our sounds combined with an interesting visual.  This really turns visual art making into an interdisciplinary experience, that includes science, technology, engineering and performance art, redefining what we might normally see as a visual art assignment.  As stated in my previous post, I felt that the theme of the project may not be appropriate for some school environments, but the kids loved it and I got to include some of their visual culture (the poop emoji) as well, which made the project interesting for them while still learning about the technology.

The video below shows my son playing the Fart Machine, then a b-roll with the sound effects dubbed over (made in iMovie)...

Art & Technology - Sound Effects

For my second project, we were asked to create 8 sound effects, using a combination of samples, which I recorded on my iPhone 7, and also sounds created on the website bfxr.net.  For all of my projects as I learn to become an art educator, I like to get my children involved as much as possible. They are 7 and 4, so their tastes and sense of humor are of the potty variety.  Although these particular sounds and subsequent "instrument" I created (see it here) are not necessarily school appropriate, I did find the creation of sound effects to be highly educational.  We were faced with the challenge of trying to recreate a particular sound without actually using the sound itself (in one case we did).  We had to implement some creativity in order to get a variety of different noises, which had that distinguishable quality of the fart noise.  

In a classroom, I would love to create a project that involved creating sounds that are either original noises or mimic existing sounds without actually using the sound itself.  This presents both a challenge to creativity and an attention to nuance and detail.  It also teaches students that we can use our sense of hearing to evoke feeling or emotion, such as humor. 

Using bfxr.net was very simple and straightforward.  It provided a variety of controls to change the qualities of the sounds, and was easy enough for me to figure out immediately, without having any prior sound creation experience.  I think this would be a valuable tool to use in the classroom when creating sound effects, and would augment or even modify the way sounds are captured as samples.  It gives a nice introduction to the history of video game sound in particular, while teaching about the variety of ways sound can be made and recorded.  Samples are also a great way to augment sound making.  As demonstrated with my "Fart Sounds" below, you can use a variety of items and materials to create sounds that don't necessarily represent what they actually are.  This project was a lot of fun for me, and for my kids as well!

Art & Technology - Thoughts on The Effects of Sound on Video Game Enjoyment

When I think of playing video games, many different images come to mind.  Not just the ones I see on the screen, but also the technology and the active process of playing.  One thing I don't readily think of is sound.  However, the aspect of sound with video games is just as, if not more, important than the use of our eyes.  Indeed, when I hear a music tune or sound effect from Super Mario or Sonic The Hedgehog, it is immediately recognizable.  The effects of sound do not only allow us to enjoy games, but also can help us connect to them emotionally, provide us with motivation (faster music helps us play more efficiently, for example) and keep us immersed in the environment of the game we are playing, in order to get more enjoyment. Background music specifically "...is used to communicate aspect of the narrative, convey emotion, and enrich the experience of the player (Fu & Zhang, 2015)."

With the further development of technology, including high definition graphics and realistic, surround sound, video games "positively affect social richness, or the extent to which a medium is perceived as socially intimate and immediate, by more accurately communicating the visual and verbal features of other social beings (Skalski and Whitbred, 2010, p. 70-71)."  In other words, the level of immersion into the video game increases when visuals are combined with music and sound, and in turn, increases enjoyment of the game. 

Although music has a great effect on this enjoyment, I think that more subtle sounds can also have an effect on immersion. My husband was recently playing a Virtual Reality demo of "The Last Guardian."  It is an action adventure game, in which players control a boy who befriends a giant half-bird-half-mammal creature, Trico.  Trico follows you around, and helps you through your quests.  At one point while playing, my husband lost sight of Trico.  Suddenly, he "felt" his presence next to him, and when he turned, Trico was sitting there.  Although he isn't sure why he felt that way, I suspect that there was some low frequency sound that alerted him to Trico's arrival.  Whether it was meant to represent his breathing, or a shift in the air caused by his mass, it was something indeterminate that had a great effect on how realistic the game was, and in turn, how immersed my husband became in playing.

I think that with all art, some sort of transportation to an idea or a feeling or a world is important to convey.  When teaching visual art, we often forget that we use all 5 of our senses when experiencing our world around us, and sound can be an effective tool to convey messages too.  Anything from music to sound effects to subtle shifts in bass or frequency, sound can evoke feeling and presence too.  This is important to teach as well, that we must not only critically investigate visual forms of representation, but evaluate all forms of representation that are used to change or redefine our worlds.

References:

Skalski, P. and Whitbred, R. (2010) Image versus Sound: A Comparison of Formal Feature Effects on Presence and Video Game Enjoyment. Cleveland State University. P. 67-82.

Zhang J, Fu X (2015) The Influence of Background Music of Video Games on Immersion. J Psychol Psychother 5:191. doi:10.4172/2161-0487.1000191

Art & Technology - Choose Your Own Adventure

For our first assignment, I created a Choose Your Own Adventure game based on the movie "Labyrinth", using Javascript.  The game allows guides you through a story, asking questions along the way with choice options that must be typed in.   Depending on the options chosen, the story proceeds in one direction or another.  Typing code to create a game for the first time, I found it to be easier than I first thought.  Once you learn the language and can trouble shoot, the rest is easy!

Teaching students about the basics of coding can allow them to have a more in depth knowledge of how new technology works, leading to a greater appreciation for the art form of video game and website creation, as well as more critical thinking about how their worlds are created and the reasons behind those creations.  This particular project really modifies the way a normal choose your own adventure story or game might work, using traditional pencil and paper.  It gives the opportunity to use a new tool and interact with it at anytime or anywhere as long as you have a mobile device. 

To play my game "Labyrinth" click here:

http://www.caitlinhazelton.com/labyrinth

Here is some sample script of the game below:

*** <script type="text/javascript">

//Create variables for all of your questions here
    
var question1 = "Do you wish for the goblins to kidnap Toby? (yes/no)";
var question2a = "Do you go back in to investigate or do you go to your room, assuming Toby fell asleep? (investigate/room)";
var question2b = "I have Toby, as you wished. Now you can enter the Labyrinth to find him or go back to your room and play with your toys and costumes. (labyrinth/room)";

//Intro

    alert("Welcome to The Labyrinth!");
    
username = prompt("What is your name?"); 
    
    if(username) {
        window.alert("Welcome new player " + username + ".");
    }    
    
    else {
        window.alert("Please restart and enter a name.");
    }
    alert("You are a fantasy loving teenager, " + username + " , who one night gets roped into babysitting your baby brother, Toby. After hours of trying to get him to stop crying, you consider wishing for the Goblin King to come take him away.");...***