AR uses
AR can be used in maps, parking guides, interior design or decorator apps and interactive art.
Also games like Pokémon Go (2016) which encouraged people to get out and about and explore the real world.
Occlusion
Occlusion in AR is when augmented aspects are hidden by the real world environment. When an AR object is occluded by objects in the real world it makes it feel more real for the user.
Light detection and ranging (LIDAR)
LIDAR uses lasers and their reflection to map the distance of objects from the camera. Can be used to map environments for AR. Better occlusion.
Marker based AR
Marker based AR projects objects onto a real world marker like an image or QR code. This means it doesn’t have any requirements for the environment that the AR will be used in as it only needs for the camera to be able to see the image.
Markerless Simultaneous Localisation and Mapping (SLAM)
SLAM can project AR experiences onto any real world environment. It can let users place a virtual object in an environment and have it stay there as they move around it which can be useful for interior design apps or online furniture shopping. However AR using SLAM relies on the environment containing flat surfaces without repeating patterns or complicated textures in order to be able to map each surface accurately.
Location based AR
Locations based AR tracks the users location using the GPS, compass and accelerometer in their handheld devices. The virtual aspects are placed in the environment by mapping them onto real-world locations and showing them to the user when they arrive there.
Ethics with AR
AR that is expected to be used in public places like pokemon Go or other location based AR can cause public safety issues if it causes people to walk around distracted especially near roads or dangerous terrain.
Example AR
Sea Shack
Making a 3D sea shack model come out of the picture.
Using the Zappar Universal AR Software Development Kit, first I had to delete any cameras in the scene and add a zappar camera instead. Then I created an image tracking target and trained the software to recognise the target image. Then I made the target a child of camera and added the image to the target. Next I added the model to the scene and made it a child of the camera as well. Then add on view events for the image to activate the model so it is displayed when the image is seen by the camera.
Then I uploaded it to zappworks AR using the unity plug-in.
Animated Sea Shack
Building the animated sea shack was the same steps with the animated model as the animation was already built in.
I imported my robot from 3D asset design module and connected the textures in unity by creating new materials with them. Then trained the zappAR software on the new image and added it to the image tracking target.
I ran into errors when exporting due to an issue with the build files building on top of each other but this was fixed by deleting all previous build files and building it again.
I tested the model at different sizes and in different positions and decided to change the target from flat to vertical so that the robot would appear parallel to the image instead of perpendicular because it allowed a better view of the face and details.
Final result
Reflection
Ideas for future work using AR
I am considering using AR for my project, as marker based AR is very accessible to users. I could create an AR experience by making my own 3D models or animations to go with a piece of 2D art.
What could be better?
Sometimes looking for extreme angles like trying to see the back of the model makes the target image go off camera so being able to move the model or having it rotate to show off the design could be something to add if I made another marker based AR project.
References
N Akkash (n.d.) Abstract digital fabric. Sci-fi background. Holographic foil. Illustration #1 Art Print Abstract digital fabric. Sci-fi background. Holographic foil. Illustration #1 Art Print by N Akkash – Fine Art America [Accessed: 10/10/24]
Niantic (2016) Pokémon Go [Video Game] Pokémon GO [Accessed: 10/10/24]