Render the product
Model the product, or bring the design team's file in as glTF, FBX or USD. Give it real finishes and studio light, and render every colorway.
3DGeoImportGLTF3DGeoMaterialCreate3DGeoSceneRenderToImage
Render a turntable →Kinematic / Who it's for / Brand experiences and retail
Stop people at the window.
A camera notices the person walking past, and the window answers: the new colors appear on their own sweater, a wave changes the look, the lights find them. Make the product renders, the film and the space in one free app, then run it on every screen in the store.
Experience designersRetail designersVisual merchandisersCreative technologistsEvent producers
The graph behind it
- InputVideoFile
- LocalAIImageToHumanParsing
- ImageMorphology
- ImageComposite
- TextRenderOverImage
Here a video file stands in for the window camera. In the store, a webcam node takes its place. OSTREL is a brand we made up for this page.
Your work
Brand work in Kinematic.
The jobs that come round on every launch, window and pop-up, from the first product render to the person who stops on the sidewalk. Each one is a handful of nodes in the same file.
01
Before the launch.
The product, the film and the pictures the campaign is built on.
Scan the product
Capture it with a phone as a Gaussian splat. Cut away the table, grade it to the campaign look, and save a small file the web shop can show.
3DGeoImportSPZ3DGeoSplatCrop3DGeoExportSOG
Grade a scan →Cut the campaign film
Clips on tracks, trimmed, faded and titled. Render one file for the web, or play it straight from the timeline on the store screens.
VideoArrangementPlayerOutputVideoFile
Cut a short →02
In the space.
Windows, walls, stands and screens, all driven from one file.
Fill the LED wall
Any picture becomes light. Pixel-map it onto an LED wall or strips and send it out over Art-Net or sACN.
ImageToDmxArtNetSendInterface
LED walls →Project onto the window
Pin a picture to a wall, mask the window out of it, or wrap a pattern around a column or the product itself.
ProjectionMapperImageCornerPinImagePolygonMask
Projection →
Feed every screen
One machine opens a window on each display, or sends the film over NDI to machines across the floor.
ImageDisplayStreamingNDISendInterface
Video →Light the stand
Moving heads find a visitor on camera and stay on them, with the rest of the rig on a cue list.
LocalAIImageToBodyPoseDmxFollowSpotEngineDmxCueStack
Lighting →03
When people walk in.
Cameras that notice people. Every model downloads once and then runs on your own machine, so what the camera sees stays in the store.
Try the colors on
Hair and clothes, or lips and skin, are picked out on the live camera and tinted, so a shopper sees the new color on themselves.
LocalAIImageToHumanParsingLocalAIImageToFaceParsing
Human parsing recolor demo →
Change the look with a hand
Thumbs up, open palm, fist and more arrive as named triggers. Wire one to a new look, a sound or a light cue.
LocalAIImageToHandGesturesDmxCueStack
Gestures →
Put a trick in the mirror
The camera remembers the empty background and paints it back over the face, leaving hair and clothes in place. A classic for mirrors and photo booths.
LocalAIImageToFaceParsingImageComposite
Hidden face effect demo →Put people somewhere else
Key a green screen, or cut a person out with no screen at all, and drop them into the campaign's world.
ImageChromaKeyLocalAIImageRemoveBackground
Keying →
Familiar work, done here
Product renders and scans.
Bring the product in or model it, give it real finishes and studio light, and render every colorway for the window, the web shop and the launch film. The same scene can play live on the store screens.
- Open the design team's model as glTF, FBX, USD or OBJ, or model it here from curves3DGeoImportGLTF3DGeoImportFBXNurbsRevolve
- Coat, metal, glass and wood finishes, lit by an HDR sky and soft area lights3DGeoMaterialCreate3DGeoLightCreate
- Turntables to H.264, H.265 or ProRes, or a PNG sequence for the editOutputVideoFile
- Scan the real thing as a Gaussian splat, then save it as SOG for the web or as one .usdz for Apple devices3DGeoSplatCrop3DGeoExportSOG3DGeoExportUSD
What you gain: sound
Sound in the same file.
The store's music, a voice or a sonic logo can move the picture, and the soundscape plays from the same graph. There is no second app to keep in sync.
- The level, the beat or one band of the music moves any number in the graphAudioEnvelopeFollowerAudioOnsetDetectAudioCrossover
- Circle a sound around four speakers with ambisonicsAudioAmbisonicEncodeAudioAmbisonicDecodeAudioPlaybackOperation
- Read an announcement aloud with a voice that runs on your own machineLocalAITextToSpeechAudio
- Hear the visitor and not the speakers: an echo canceller takes your own soundtrack out of the micLocalAIAudioEchoCancelLocalAIVoiceDetect
What you gain: simulation
Liquids, cloth and fire.
A splash of paint for a beauty launch, a cloth over the plinth, fire on the wall of the pop-up. Render them for the film, and send the same frames to the LED wall and the lights.
- Liquids that splash, pour and marble, each paint keeping its own color3DGeoFlipSimpleSolver
- Cloth that drapes over the product or flies as a flagPBDSimDrapePBDSimSolver
- Fire, smoke and particles for the launch film and the screens3DGeoFluidSimpleSolver3DGeoParticleSimpleEmitter
- Pixel-map the result onto an LED wall, with more than 1,500 fixture profiles built inImageToDmxArtNetSendInterface
Opening day, and every day after
Run it in the store.
A window is judged on the day nobody from the agency is there. These are the parts that keep a piece running with staff who have other jobs.
A day in the store
- Before openingThe machine starts and the piece opens full screen, with the edit keys off and the screens kept awake.
- Opening timeThe scheduler fires the morning look at the time you set, with one schedule for weekdays and another for weekends.
- New contentSave a new version of the file and the running piece reloads it, keeping its windows and live values.
- Something falls overA crash restarts the piece on its own. A stalled graph is ended by the watchdog and comes back the same way.
- A quiet spellFor a kiosk with a mouse, keys or a controller, an idle timer brings the attract loop back.
- Closing timeHalf an hour before sunset, or at a time you choose, the window dims for the night.
$ kinematic window.kin --kiosk --display 1 --no-controls --watch \ --restart-on-panic 10 --watchdog 30s --health-port 9797 \ --error-strip off --var store=12 \ --control tls:0.0.0.0:7401 --control-token-file token.txt $ kinematic ctl --token-file token.txt tls:10.0.0.12:7401 state recall spring
Add it to the login items on a Mac, or a desktop session service on Linux, and it starts with the machine.
DmxSchedulerInputIdle
Every store from one desk
Start each machine with a control socket and a token. From head office you can check on it, recall a saved look, move its outputs or grab a screenshot of what it shows.
One file, set per store
Pass a value at launch, such as the store or which screen it is, and every machine runs the same graph file.
No error text in the window
Turn the error strip off and nothing is painted over the picture. Errors still go to the log and the health check.
A health check for the building
A port answers whether the piece is running, which frame it is on and how many errors it has seen.
Sealed off the network
The camera models download once. After that, an offline launch never waits on a download.
A cursor that keeps out of the way
In kiosk mode the pointer hides once it stops moving.
How it fits
Your gear and your files.
What plugs in, what it drives, and the files that come and go. Every entry is on the full list of what Kinematic works with.
Reads the space
- Webcams and capture cards
- Gestures, bodies, faces, clothes and the size of the crowd.
- Depth cameras
- Orbbec Astra, Gemini and Femto. RealSense-style cameras on Linux.
- Touch screens
- Every finger at once, with where it landed and how hard it presses.
- Phones and tablets
- A touch page served from the graph, or TouchOSC.
- The web
- Webhooks from a booking page or a form, HTTP requests out, and WebSockets both ways.
- Sensors on a dev board
- Anything on a USB serial port.
Drives the space
- Screens and projectors
- A window of its own on any display, full screen.
- LED walls and DMX lights
- Art-Net, sACN and USB DMX adapters, with more than 1,500 fixture profiles.
- Other machines
- Video over NDI, or Syphon on a Mac. It can also serve its output over RTSP to a kiosk player.
- Speakers
- Stereo, or a ring of four from ambisonics.
- Receipt printers
- A take-home slip, printed over a serial port.
- Show control
- QLab and lighting consoles over OSC.
Files
Opens
glTF, FBX, USD, OBJSplats: SPZ, PLY, SOG, .splatMP4, MOV, MKV, WebMPNG, JPEG, TIFF, EXRThe brand fonts: TTF, OTFLogos as SVGLooks as .cube LUTsWAV, FLAC, MP3CSV and JSON
SavesH.264, H.265, ProRes, VP9PNG and EXR sequencesglTF, FBX, USDScans as SOG for the webScans as .usdz for Apple devicesSVGWAV, FLAC, AIFF
Everything it works with →
Where to start
Tutorials and demos.
Short lessons that end with something working, and demos that come with the app. Open a demo in the app, take it apart, and keep what you need.
Tutorials
All the docs →
TutorialDraw a mountain logo8 min
TutorialTurn a chrome ring into gold8 min
TutorialMap moving patterns onto three panels10 min
TutorialLine up a projection on a wall from the side7 min
TutorialPlay a video on a wall of LED lights9 min
TutorialMake a visual that pulses to your music12 minDemos
Browse every demo →
WebcamHuman parsing recolorHair and clothes picked out on the live camera and tinted, with the clean mask beside it.In the Demos browser
WebcamFace parsing recolorLips and skin found on the live camera and tinted, ready for makeup looks.In the Demos browser
WebcamGesture triggerThumbs up, open palm or fist, each a named trigger for a new look, a sound or a light.In the Demos browser
WebcamHidden face effectThe face disappears and the background is painted back over it, hair and clothes kept.In the Demos browser
Retro neon effectsA neon sign built from stacked text effects, with a tube outline and a double glow.In the Demos browser
Projection mapper multi-textureStripes, dots and a star, each fitted to its own panel in the mapper.In the Demos browser
Paint splashCrimson and teal paint drop into a tray and marble together.In the Demos browser
GPUscan by Niantic Labs, MIT licenseSplat turntableA carved lizard on a low plinth, turning slowly on the spot.In the Demos browserBefore you plan the build
What it does not yet do.
Better to know now.
Something here would stop your project? Reach out.
- Sending visitors their photoThere is no node that emails or texts a picture to a visitor yet.
- Photo printsNo node sends a picture to a photo printer yet. Receipt printers on a serial port work today.
- Kinect and ZED camerasThese depth cameras are not supported yet. Orbbec cameras work, and RealSense-style cameras on Linux.
- TUIO touch tablesThere is no TUIO node yet. A touch screen the system sees works today.
- Projector powerNo PJLink control to switch projectors on and off from the graph yet.
- Spout on WindowsVideo sharing between apps on Windows is on the roadmap. NDI works on every platform, and Syphon on a Mac.
- Screens kept awake on LinuxKiosk mode keeps screens awake on macOS and Windows. On Linux, turn screen blanking off in the system settings.
- Daylight savingThe scheduler does not move its clock for daylight saving. Update its offset on the day the clocks change.
Your next window
Download Kinematic.
Free. No account, no license key and no seat count, so every screen machine in every store can run it, even for commercial use. macOS, Windows and Linux, with experimental Raspberry Pi support.