All posts by Thorsten Fleisch

Gestalt [2003 / 2008]

DV, 5:20 minutes

Four-dimensional quaternions (fractals) are visualized by projecting them into three-dimensional space. Instead of modeling objects of human imagination the realm of mathematics is explored. Only the variables of one formula (x[n+1]=x[n]^p-c) were changed. It took me about a year to get an idea of the transformations and shapes which could be expressed by this formula. Almost another year was needed to render the sequences which I decided to use.

I added some sketches to the Sketches category here, here and here

More on the 4th dimension here

Awards:
-Honorary Mention at the Prix Ars Electronica 2003
-Best Video/Computer Art at the Asolo Film Festival
-Best Experimental Film at the Lausanne Underground Film Festival
-Low Budget Video Award at the Microcinefest
-nominated for the Imagina Award at the Imagina

Gestalt is available on the following DVD compilations:
-CyberArts 2003 – International Compendium Prix Ars Electronica
-Imagina Trips – Volume 2
-art_clips.ch.at.de

Gestalt_HD_2008 [2008]
HD, 5:20 minutes

A re-rendering of Gestalt in HD and 16:9. Since this film is basically a visualization of a mathematical body it is theoretically possible to render it in as high a resolution as technically feasible. One would always get more detail. The visual structures and transformations that one can see in the film are only inferior representations of much more complex visual ideas that exist in four-dimensional space and are not bound to a certain resolution or 3D representation. In theory it would be possible and more true to the original formula to show the visual transformations as a 3D hologram where one could then perceive different perspectives that are of course not available in the conventional film format.

Hautnah / Skinflick [2002]

16mm, 7:30 minutes

Three different levels of skin working with film / film working with skin:

– fingerprints on clear leader
– carefully arranged successive skin prints
– snapshots of light-painted skin becoming leather

The images are accompanied by soundscapes using aural skin scans performed by the cartridge of a record player.

Finished with a grant from the Filmbüro NW

Awards:
Best Experimental Film at the Microcinefest 2002
-Kodak Award at the 36th New York Exposition of Short Film and Video
-Honorable Mention for Animation at the 35th Humboldt International Short Film Festival
-nominated for Best Experimental Film at the Dahlonega International Film Festival

Animating the 4th Dimension

The following article was published in volume 13 of Animation Journal edited by Maureen Furniss. Get your copy here.

Animating the 4th Dimension

Since the later part of the 19th century people have been interested in the fourth dimension. Very popular at that time it fascinated and left room for all kinds of speculations. A lot of assumptions have been made. Some people even assumed it must be the place where god resides, heaven. Especially artists took a great interest in the fourth dimension. Writers like H. G. Wells, Alfred Jarry and Fyodor Dostoevsky and avant-garde artists like Marcel Duchamp, Francis Picabia, František Kupka, Kazimir Malevich, Umberto Boccioni and others were influenced by its theoretical implications. Marcel Duchamp even studied higher dimensions very seriously. In his work The Bride Stripped Bare By Her Bachelors, Even (The Large Glass) the bride (see picture below, left) was meant to be a four-dimensional entity in contrast to the more simply constructed three-dimensional bachelors.

Another example would be Unique Forms of Continuity in Space (see above, right) a sculpture by Umberto Boccioni.

It can be said that some of the avant-garde styles like Cubism, Futurism, and Constructivism emerging at that time were highly influenced by the expanded vision of space the fourth dimension offered. This all changed when Einstein made time the fourth dimension in his theory of relativity. The extra dimension that was undefined and mysterious before now served a scientific purpose to better understand our universe. People became more interested in Einstein’s discoveries and what would result from the assumptions he made. But with the rise of computer technology some scientists returned to the fourth dimension for purely geometrical studies. Through animating four-dimensional objects in motion not only fascinating abstract images emerge but also the almost incomprehensible, dry theory becomes a bit more accessible by rather seeing patterns and structures than reading about them (unless you are a mathematician of course).

With this essay I’d like to share my fascination with the fourth dimension in motion that brought me to making “Gestalt” a computer animation featuring four-dimensional fractals called quaternions. Another subject I’d like to touch briefly is fractals. I have long been fascinated with fractals. When my brother showed them to me on his computer I was in awe that these beautiful patterns not only have such interesting features like self similarity but were also created by using only a simple formula. We tried to make small animations of zooming in their structure by taking single frames from the monitor screen with our dad’s super 8 camera while we were changing the parameters of the formula. The results were not very satisfying for both of us due to the technical limitations.

But first please let me introduce you to the fundamentals of understanding four-dimensional geometry. Next I’ll try to give a brief introduction to quaternions, the fractal entities living in 4d space. Freshly equipped with a basic understanding of the subject matter I will then give some examples of 4d related animations artists and scientists have done so far.

The Hypercube

In 1966 Michael Nöll and his associates at Bell Laboratories produced an animation of a hypercube using computer graphics. It was the first time a hypercube was visualized in motion. Later in 1978 Thomas Banchoff and Charles Strauss produced the film “The Hypercube: Projections and Slicing”. This award winning film shows a more complete approach to the animated hypercube. A hypercube is a four-dimensional cube. Now what does that mean?

Before I try to explain the concept of four-dimensionality I’d like to give a few words of advice. To understand the fourth dimension, don’t try to understand the fourth dimension. With this cryptic sentence I’d like to point out that you should not try too hard to ‘understand’ the fourth dimension, e.g. how it looks like in the real world. There is no fourth dimension in reality. It’s a concept of an artificial space that bears no direct similarity to real space. Try to think of it as geometrical extravaganza. It is constructed with mathematical means by analyzing three-dimensional space and how the three dimensions relate to each other. The extra dimension is added due to the geometrical laws found in the first three. Think of it like for example the concept of eternity which you don’t find in the real world either or the concept of negative numerical values. In reality you can count the things you see but things are either there (positive value) or not there (zero value) but how can they be negative? The concept of negative values only makes sense if you work with numbers in an abstract way. Of course we are used to them and they don’t appear strange to us anymore but it is an altogether abstract and artificial concept similar to the one of a four-dimensional space.

To get an idea of the fourth dimension maybe it would be a good start to begin with a point. A point has zero dimensions. It only exists in itself and has no possibilities to move anywhere. If we put another point at the right side beside the first one and connect them we get a line. A line has one dimension. It is now possible for the zero-dimensional point to travel within the line in a left and right manner. Now we move the line perpendicular to itself in a plane and we get a square. A square has two dimensions. The point can now travel left and right as well as up and down. Moving the square perpendicular to itself results in a cube. A cube has three dimensions. The point is happy because it can travel even more. It can now move in three directions: left and right (x-direction), up and down (y-direction) and back and forth (z-direction). So now to make the point even happier we move the cube perpendicular to itself in kata direction to get a hypercube. So here it is, the four-dimensional hypercube. The point can now move in four directions: left and right (x-direction), up and down (y-direction), back and forth (z-direction) and ana and kata (w-direction).

As you might have noticed the point can travel now in a direction (ana and kata or w-direction) that we, bound to three-dimensional space, can’t go. This is the new direction that makes the fourth dimension. But what about time being the fourth dimension? Well, time can be the fourth dimension. It would then be called four-dimensional space-time and is used in Einstein’s famous Theory of Relativity. In geometry it is possible to extend space to as many dimensions as you want. The same way we moved the cube perpendicular to itself into hyperspace (four-dimensional space) to get the hypercube we can lift the hypercube perpendicular to itself into five-dimensional space to get a five-dimensional hypercube. This could be done again and again up to n-dimensions. For our zero-dimensional point each additional dimension means one direction more to move in. Since our three-dimensional space can be described in mathematical language it is possible to extend it by mathematical means even though in our physical world we do not have access to it.

How to Visualize the Hypercube

Even though we cannot grasp the fourth dimension directly there are several ways to access it. All of the following methods were developed by Charles Howard Hinton. First, in order to visualize the hypercube it would be good to know its geometrical attributes. Compared to a cube which can be described geometrically as consisting of 8 vertices (0 dimensional object), 12 lines (1 dimensional object), 6 faces (2 dimensional object) and the cube itself (3 dimensional object) the hypercube can be described as being made of 16 vertices, 32 lines, 24 faces, 8 cubes and 1 hypercube. One method to get an idea of the hypercube is to unfold it. Below you find a picture of an unfolded hypercube called a tesseract next to an unfolded cube for comparison:

Whereas the cube unfolds into 2d space and is made of six squares the hypercube unfolds into 3d space and is made of 8 cubes. Another way of visualizing a hypercube would be to project it from 4d space into 3d space. The next picture shows a projected hypercube:



Here you can also see the 8 cubes. Clearly recognizable is the big cube with the smaller cube inside. There are also six cubes around the small one which connect it to the big one. Because of the projection they are distorted so they look like six pyramids with their apex cut off. All cubes have originally the same size but are distorted due to the projection. The small cube is farther away in kata direction (w-direction) from the big cube and the six other cubes connect the two cubes in a way four squares connect the nearest square with the farthest square in a projection of a cube onto a 2d surface. A 4d to 3d projection is quite similar to a 3d to 2d projection. We are used to 3d projections because we see them all the time in pictures or in movies. In order to visualize depth in a 3d projection on a 2d surface we use a vanishing point and make the objects farther away smaller. In the 4d projection into 3d space the objects that are farther away in kata direction are also shown smaller. Now in order to animate the hypercube you can rotate it and the projection will look like this:

You can see the dark inner cube change position due to the rotation in 4d space. Also the cube is squashed during the process.

Another way to visualize a hypercube is by continually slicing it from top to bottom. Again let’s start with a cube for comparison. If you take a cube and want to slice it you have several possibilities to do so. You can slice it beginning with a face which would result in several identical squares. Also you can slice it edge first. This would result in a series of rectangles starting and ending with a line. The rectangles will widen while keeping the same length until, halfway through the cube, the transformation will revert itself. Now another method of slicing would be to begin slicing vertices first. First we get a point which becomes a triangle. The triangle increases in size until it transforms into a hexagon halfway through the cube. There, again, the process reverts itself. Please consult the picture for details:

What now if we slice a hypercube? First of all we’ll get 3d slices. If we slice cube first we only get a bunch of identical cubes. By slicing face first we get a square which will get thicker until it becomes an oblong box halfway through the hypercube. It then will diminish in thickness until it will be the square it was in the beginning. So basically the slices are very similar to the slices of the cube beginning with the edge. Just an extra dimension (thickness) was added (cube => hypercube: line => square, rectangle => oblong box). If we now slice the hypercube edge first the slices will be similar to the ones of the cube beginning vertices first. You just have to add that extra dimension of thickness to it. So it would start with a line expanding to a triangular prism with its height exactly the same as the original edge. Halfway through the hypercube the triangular prism changes to a hexagonal prism and than changes back to the triangular prism and finally the line (point => line, triangle => triangular prism, hexagon => hexagonal prism). But the most interesting slices we do get if we slice the hypercube vertices first. First we get a point that transforms into a small triangular pyramid, a tetrahedron, which increases in size until its vertices are cut off . Its size increases until it changes into an octahedron when it is in the middle of the hypercube. It then shrinks back to the tetrahedron (rotated by 45 degrees around the x-axis) with its vertices cut off until it becomes the full tetrahedron again which shrinks further until it’s the point it was at the beginning. You can see the different slices here:

Now you can just put all the slices you made for one frame each and you have an animation of a continuous 3d slide of a hypercube.

Quaternions

Quaternions are a group of numbers that consist of one real number and three imaginary numbers. So they are made of actually four numbers altogether. They are fundamental for quaternion fractals a special group of fractals that reside in 4d space. Those quaternion fractals can be projected into 3d space and so be made visible as 3d objects. You may have heard about Mandelbrot sets or Julia sets. These are 2d fractals. A common Mandelbrot fractal looks like this:

The base of 2d fractals is complex numbers which consist of one real number and one imaginary number. Complex numbers were discovered by Leonard Euler trying to solve the equation x² = -1. Since this is not possible with real numbers alone he had to invent imaginary numbers to solve it. Almost a century later William Rowan Hamilton discovered quaternions which even had three imaginary numbers beside the real number. Quaternions play an important role in quantum mechanics. But included in a fractal geometry framework they also provide a powerful visual stimulus. Here a picture of a quaternion fractal:

Instead of further explaining the technical side of quaternion fractals I’d rather like to give some personal account of my own work in the realms of 4d quaternion animation.

Animating Quaternions

While I was investigating 4d geometry, I stumbled upon quaternion fractals. I was fascinated by the universe of bizarre shapes and forms that could be expressed by a single mathematical formula. Wondering how it would look if I changed some parameters over time, I experimented with animating them. I was captivated by the results. The program I used for renderingquaternions I found on the web. It’s called Quat and was written by Dirk Meyer. It’s a very powerful quaternion fractal generator that is freeware. Unfortunately it is only possible to render single images with this software. So I had to write my own little program that would feed Quat with data for sequences of slowly transforming shapes to render. I fiddled with every parameter that could be changed and did series of images while gradually changing one or more parameters to test if something promising would develop. This procedure posed a real challenge to my patience. Though I did only small resolution test renderings they sometimes took half an eternity to finish. But at the same time I was really enthusiastic about the results I got. When I had enough material I began rendering the sequences I liked most in a higher resolution. That was the biggest challenge to my patience ever. It took almost a year and would have taken even longer without the help of family and friends who donated computer time. So after the renderings were finished I just had to put the sequences together in a way that made sense to me. I tried to show many facets of the mathematical body and transformations of it. For the soundtrack I referred to FM-Synthesis. I like the sound of it and found it matched the bizarre, highly artificial, somehow alien shapes. I named the film ‘Gestalt’ and it’s available for download on my website.

Now please let me elaborate further on my fascination with fractals, the fourth dimension and mathematics in general. It was Pythagoras who made the belief in numbers central to his worldview. He founded the Pythagorean Order who tried to live science, to directly integrate scientific observation in practical life. Their aim was to understand the divine order of the world. It was believed that this order was a mathematical one. For them numbers weren’t arithmetic alone but entities of their own. It was these entities that were divine because in their worldview they alone had the power to fully explain the universe. In modern physics today there is one branch that dedicates their efforts to finding the one theory to describe the order of the universe. Superstring Theory. This theory is by no means completely understood even by the people working on it. It’s said that scientists stumbled on this theory that was originally meant for the next century to discover. And it’s also not quite clear if this theory actually works. There is a lot of controversy. But the scientists who dedicate their life to it are captivated by its elegance. Superstring Theory uses higher dimensional space. It places unimaginably small vibrating strings as the basis for all matter and comes in different flavours of which the ‘smallest’ is embedded in a 10 dimensional space and the ‘biggest’ makes use of a 26 dimensional space. Superstring Theory is an attempt to unify all four forces (gravity, electromagnetic force, weak nuclear force and strong nuclear force) which according to physicists constitute our universe. These aspects of numbers, mathematics and science are central for my approach to ‘Gestalt’. Actually working with the tools (numbers, mathematics) used to explain the fabrics of space I sometimes felt like a painter who some centuries ago used to paint biblical scenes to let the beholder feel a glimpse of the divine.

4D Today

If you browse the internet looking for 4d related sites you find very diverse applications of 4d geometry. I’ll try to give a short summary of what I found during my quest for 4d stimulus.

Games

Hyper is a playable demo of a first-person-shooter dealing with an extra fourth dimension. Added to the conventional FPS control keys are two extra keys that move the player in ana and kata direction in 4d space. If you go in this extra direction the space around you changes, the room transforms. Doors may appear that weren’t there before. Unfortunately this demo presents only a rough sketch. The gameplay as such is not very elaborated. But it introduces a totally new element to the FPS genre. [Unfortunately the website with the demo is no longer online]

Other 4d extensions of popular games are:

4D Rubik’s Cube

4D Rubik’s Cube Java Applet

Chesseract

4D Maze

Art

I’d like to focus on three contemporary artists influenced by the fourth dimension. First the painter Tony Robbin, who also wrote a book on the fourth dimension and art called ‘Fourfield: Computers, Art and the 4 th Dimension’. He also wrote some programs to visualize higher dimensional objects which can be downloaded at his website.For his paintings he transfixes complex patterns derived from his research in 4d geometry on canvas. On some of them wire arrangements are added to provide even more depth. With the wire structures changing in perspective when passing the painting the painted structures remain fixed on the canvas-space. This interplay of perspective and motion directly refers to phenomena that can be observed in hyperspace.

Another contemporary artist working with 4d geometry among other tools is the ‘transarchitect’ Marcos Novak. His liquid architectures / transarchitectures as he names them are highly elaborated spaces that exist in cyberspace. cyberspace here means the space that only can be provided by a computer and far surpasses the notion of space as we know it. Whereas architects use the computer as a tool to construct for the real world he rather constructs for the same space he constructs with, the virtual space. Since the virtual space of the computer is made of mathematics alone it can be extended and broadened by mathematical means. Marcos Novak makes full use of this fact.

Last but not least there is Manfred Mohr. He came from Action Painting and later developed his unique style of cube semiotics that are calculated and plotted by computers. From the 3d cube he moved on to higher dimensional cubes. He says about his work: “In my research, since 1973 I have been concentrating on fracturing the symmetry of a cube (including n-dimensional hypercubes since 1978), using the structure of the cube as a “system” and “alphabet”. What interests me, are the two-dimensional signs (êtres- graphiques) and their visual ambiguity resulting from the projection of the lines of the cubes from higher dimensions into two-dimensions. I describe them as unstable signs because they evoke visual unrest.”

Animation

A lot of 4d animations can be found on the web. Most of them are very short. They show for example what a 4d object looks like when rotated in 4d space. Also the slicing method is sometimes used to explore certain properties of 4d objects.

4d Star Polytope Animations

Stereoscopic Animated Hypercube

Thomas Banchoff’s Project List Very interesting animation studies by the author of ‘Beyond the Third Dimension’ and producer of ‘The Hypercube: Projections and Slicing’.

Gallery of Mathematics Very nice animations of for example a hyper-torus and an inflated hypercube. Also very thorough information on the mathematics involved.

Hyperspace Star Polytope Slicer A java applet with lots of parameters to fiddle with. Should not be missed.

Lots of quaternion animations [unfortunately hypercomplex.org no longer exists]

Among other things a vrml model of a Calabi-Yau manifold a 6d object that is important to Superstring Theory.

Beyond the Third Dimension This virtual exhibition consists of mathematical objects that are visualized in the computer. It shows relations between Mathematics, Art and Computer Graphics. Its images try to suggest geometrical intuitions evoking the mathematical notion of dimension.

Outside In Turning a Sphere Inside Out

Recommended reading: Fourth-dimension and fractal geometry

Popular Science:
Beyond the Third Dimension – Thomas F. Banchoff (New York: Scientific American Library, 1990)
Hyperspace – Michio Kaku (New York: Oxford UP, 1994)
Chaos – James Gleick (New York: Viking, 1987)

Fiction:
Flatland – Edwin Abbott Abbott (1884. Princeton: Princeton UP, 1991) available online here
And He Build a Crooked House – Robert A. Heinlein (New York: Amereon House, 1983)
Tangents – Greg Bear (London: Viczor Gollancz, 1989)

Art:
The Fourth Dimension and Non-Euclidean Geometry in Modern Art – Linda Henderson (Princeton: Princeton UP, 1983)
Fourfield – Tony Robbin (Boston: Bulfinch, 1992)

Silver Screen [2000]

16mm, 5 minutes

A film made entirely with foil paper, exploring its possibilities in the realm of the audiovisual. For each frame a new foil paper landscape was created changing the parameters of light and perspective. In order to match the rapid flow of images several foil paper sounds have been restructured and edited.

Awards:
Silver Screen received an Honorable Mention at the 3rd Seattle Underground Film Festival and at the 21st Annual Black Maria Film & Video Festival

Superbitmapping [2000]

16mm, 2:30 minutes

A projected text is going through two transformations in terms of presenting information. At first one is able to understand its meaning. In the second stage however the text has been transformed into digital language which can only be read by a computer. Finally, with the third level, the digital code has been used to convey a flicker effect. The text is now a mere physical sensation devoid of intelligible contents.

Blutrausch / Bloodlust [1998]

16mm, 4:20 minutes

An attempt to constitute a human / machine dialogue. It shows the filmmaker’s blood as seen / heard with the eyes / ears of the machine which is a film projector with optical sound. He affixed his blood onto clear film leader by cutting into the flesh and then pressing the film leader onto the wound. Additionally he had blood taken with a syringe and afterwards dripped it on the film leader. fresh and clotted blood was used.

Awards:
Blutrausch/Bloodlust received the Ann Arbor Film Coop Award at the 38th Ann Arbor Film Festival in 2000 and the Special Jury Award at the 5th Microcinefest in 2001

K.I.L.L. [1998]

K.I.L.L. – Kinetic Image Laboratory / Lobotomy [1998]
VHS, 3:30 minutes

An accumulation of 180 different perspectives of a bank’s skyscraper. Each perspective takes just one frame.At first there is chaos, then systems of visual organisation develop. The sound consists of a sampled phrase meaning: “Our power is boundless and our means are inexhaustible”. The editing plays with the relationship between the words and the images creating different meanings in breaking the succession of the words.

Awards:
K.I.L.L. was nominated for Best Experimental Animation at the Bradford Animation Festival 2000.

Expanded Cinema Pieces

Instructions For Films – Peristaltic Fantasy [2007]
Idea for a film on a white card

Over forty international artists who use the moving image in their work, were sent a white card measuring 20cm by 15cm, with the following invitation: ‘On the card enclosed propose instructions for a film. You may render the instructions by any means and appendages.’

Here is what I came up with:

Peristaltic Fantasy Front

Peristaltic Fantasy Back

From ‘Instructions For Films‘, a n.o.w.here publication

————————————————————————————————————————

Der verbotene Film/Forbidden Film [2006]
16 mm

An experiment in film narration. Read more here.

————————————————————————————————————————

Möbius Filmschleife/Möbius Filmloop [2003]
16 mm

A 16 mm loop spliced together like a möbius strip meaning that the one end meeting the other is turned by 180 degrees. To ensure projectability double perforated film used. Download the actual loop [3 mb] here. Choose play looped, watch for about 5 minutes.

————————————————————————————————————————

ZUSE [2002]
35 mm

Structural films use mathematical means in order to arrange frames. A reflection on the serial nature of film. ZUSE is an exact copy of an original program for the Z3 computer made by konrad zuse in 1941. He is considered the father of today’s computers. His calculating machines (Z1, 1938 & Z3, 1941) were programmed with perforated 35 mm film. The program used to make ZUSE originally helped to factor out a polynomial. A small comment on the mathematics involved in structural film and thus a meta-structural film.

qed

————————————————————————————————————————

Feuer Frei/Open Fire [1998]
16 mm

Shots of something burning, clear and black leader treated with fire and smoke. Unscreenable!

————————————————————————————————————————

Der Antifilm/The Anti-Movie [1997]
Super 8

Black leader arranged in various ways to prevent screening. Sprocket holes cut off at some sequences. Other sequences spliced together with the sprocket holes at the opposite side. In case of projection this film would rather destroy itself than expose its black soul.