#About
Enhance the experience of the educational process in clothing design with Wacom WILL 3.0 SDK by using a stylus to model & texture clothes that can be worn in AR.
Inkathon HomePage PressKit GitHub ProjectDemo Video
#Problems to solve
Fashion industry has already deployed digital painting techniques into the process of clothing design. But (1) it is still painful to learn how to model and texture clothes, because one need to project 3D model onto 2D canvas. Also (2) it is difficult to directly visualize how would clothes look in real world and (3) it is equally difficult to make teachers and students collaborate on the same project.#Solution
Introducing Air Ink!Use Wacom WILL 3 SDK to design clothes with 3D brushes, EdTech in clothing design is that easy. XD
(1) No need to learn how to 3D modeling & UV packing, just walk around and use the stylus as you would normally do on 2D screen and it automatically make it for you in 3D.
(2) No need to do real production, preview live appearances by providing virtual clothes that follows human skeletons.
(3) Easy to work on the same project with local networking that enables many people to paint on the same cloth. Changes are reflected on everyone's screen in real-time!
#User Flow
1. Find A Person
Open the app and point the camera to the person on whom you want to paint. As soon as Air Ink detects a human, a skeleton would shows on the screen to indicate the presence.
2. Paint the Skeleton
In preview mode the skeleton will follow the human, but when doing painting, the skeleton would be static to make painting easier. Switch to paint mode so that you can see material and brush settings. Paint freely!
3. Real-time Preview
When you are done painting, switch back to preview mode and now skeleton along with the cloth would follow the human. Make some movements and see how clothes looks & fit on human body!
#Technologies Inside
- Unity 2019.3.0 Beta
- ARKit 3.0
- WILL 3.0 Beta SDK
- In order to make wearable clothes in Augmented Reality, we first need to track human skeleton, and the ARKit 3.0 happened to have the motion tracking capability on iPad Pro.
- Then we need to a game engine to render AR scenes, and Unity is a great choice as we can leverage its graphic power and its tight integration with ARKit and Wacom SDK support.
- Finally, the WILL 3.0 Beta SDK provides us with necessary 3D painting function that free us from traditional canvas space limitations and turns our Air Ink into a world space modeling and texturing application.
#Other Info
Team Members
#Issues & Future
There are quite a few things that we want to address here. See it if you want to: