Matt DesLauriers
Aesthetics

Matt DesLauriers

Synthetic Gestures

gradient-free optimisation clip-guided stroke-based rendering sketch synthesis browser-based implicit neural representation

Synthetic Gestures is a generative drawing machine and custom machine learning system. An implicit neural representation (SIREN) is optimised with an evolution strategy (sNES) to maximise similarity to a text prompt, guided by CLIP. The system parameterises a series of expressive strokes made with the mechanical arm of a pen plotter, producing recognisable forms of text prompts like “sailboat,” “bird,” "tomatoes," and more.


The work is realised as a series of plotter prints, alongside a digital display cycling through outputs from various prompts. Drawing paths are initialised randomly, then slowly evolved towards a set of trajectories that maximises semantic recognisability to the input prompt. The system can optimise disconnected, noisy, and multi-colour plotter drawings, a few variants of which are shown here. The continuous, gestural quality of the strokes sits within the context of surrealist and dadaist drawing systems, such as Exquisite Corpse and automatism.


The software follows a long history of artists creating their own tools and working with drawing machines. The use of SIREN, a sinusoidal implicit neural representation, was inspired by Desmond Paul Henry's (1921 – 2004) early spirograph-like drawing devices, modified from WW2 bombsight computers. The artwork also draws on the constraints faced by early computer artists, including Harold Cohen (1928 – 2016), who developed AARON, a suite of software and robots that could semi-autonomously paint representations such as plants, people, and scenes.


By using a derivative-free evolution strategy rather than gradient descent, the system can introduce noise, discontinuities, discrete operations, and other features that are typically challenging with end-to-end differentiable renderers. The rendering, optimisation, and live-editing workflow is built in JavaScript and runs in a web browser, giving the artist a tighter feedback loop to iterate on.

Learning to draw a bird, with different stroke parameters per row. Each subsequent column is a later generation of the same prompt.

Learning to draw a bird, with different stroke parameters per row. Each subsequent column is a later generation of the same prompt.

The implicit neural representation (SIREN) encodes the drawing as a series of pen plotter gestures, layered by pen colour.

The implicit neural representation (SIREN) encodes the drawing as a series of pen plotter gestures, layered by pen colour.

Matt DesLauriers
About The Artist University of the Arts London (CCI)

Matt DesLauriers is a Canadian-born artist now based in the United Kingdom. His practice focuses on a playful exploration of code as a creative medium, often driven by emergent, generative, and algorithmic processes. His work has been exhibited internationally, including at Somerset House in London, Paris Photo in France, Kunsthalle Zürich in Switzerland, MoCA Taipei in Taiwan, and Art Basel in Miami and Hong Kong. Matt is active in the open source community and has given numerous talks, classes

Matt DesLauriers is a Canadian-born artist now based in the United Kingdom. His practice focuses on a playful exploration of code as a creative medium, often driven by emergent, generative, and algorithmic processes. His work has been exhibited internationally, including at Somerset House in London, Paris Photo in France, Kunsthalle Zürich in Switzerland, MoCA Taipei in Taiwan, and Art Basel in Miami and Hong Kong. Matt is active in the open source community and has given numerous talks, classes, and workshops on creative coding, including previously tutoring at UCL Bartlett School of Architecture in London. He is now pursuing a PhD at UAL Creative Computing Institute, researching colour, perception, and machine learning within the context of computer art.