🇯🇵 このサイトは日本語でもご覧いただけます — 日本語ページを見る →
S
Sidekick Lab
by Ichiro Murata

Connecting the Stars Before I Knew What It Was Called

— It started with a climber's headlamp on Mt. Tsubakuro

I had never heard the term "lighten composite" when I stacked two frames of a climber's headlamp on Mt. Tsubakuro and found a way to keep only the bright parts. From there: continuous star exposures, "Infinite Track" in Digital Photo, April 2010, and software to automate the work.

Ichiro Murata · Photographer / Sidekick Developer

I never set out to do lighten composites.

Back then I did not even know the term "lighten composite" existed.

(The Japanese name for it translates as "lighten composite": in Photoshop it comes down to stacking the frames with the Lighten blend mode, so that only the brightest pixels from each frame survive.)

It did not start with stars, either.

It started with a climber's headlamp, photographed on Mt. Tsubakuro.

It started because I had no photo to hand in

In the late 2000s I was taking part in the "Nikon–Yama-Kei Photo School" as a guest instructor.

The lead instructor was the mountain photographer Tetsuo Kikuchi.

At the session held on Mt. Tsubakuro I was there as an instructor, so I was not concentrating much on shooting my own work.

After we came down, though, someone from Nikon asked me to submit one photograph.

That was a problem.

I had not really shot anything of my own.

Looking through the images I had taken, I found one — before dawn, I think — where a climber wearing a headlamp had crossed near Iruka-iwa, the "dolphin rock."

It looked usable as a photograph.

The trouble was that the light trail from the headlamp was short.

If the line of light were a little longer, it would be a far more interesting picture.

Fortunately I had shot several frames while varying the exposure, so the adjacent frames had the headlamp's light in other positions.

So I layered two of the photographs in Photoshop and tried various blend modes.

And there was a combination that kept only the bright parts of the two photographs — only the headlamp's light trail — in a single image.

"That gets me out of trouble."

That was all I thought at the time.

I did not think I had discovered a new shooting technique.

Still less did I know that it had a name.

"Wait — could this work for stars?"

Some time later, while walking in the mountains I think, I found myself remembering what I had done in Photoshop.

Around then, cameras like the Nikon D3 had greatly improved high-ISO performance, and it was becoming genuinely possible to photograph stars digitally.

I had been trying star photography myself.

And I thought:

Take many short exposures of the stars, one after another.

Then stack them the same way I stacked the headlamp frames.

Wouldn't the stars join up into lines?

I decided to try it.

The first attempt was maybe thirty minutes to an hour, as I recall.

I shot the stars continuously, went home, and stacked the frames in Photoshop.

The stars joined up.

Looking back, that was my "test zero."

When I looked into it, others had got there first

I want to be careful about this part.

I did not invent the lighten composite.

Once I knew the stars would join up, I started gathering information online.

There were already people shooting nightscape photographs with more or less the same method.

One of them was Masanori Higashiyama.

I was not from the world of astrophotography, so there was a great deal I did not understand.

So I emailed the astronomy people I found online, one by one, and asked questions.

To be honest, the responses were fairly cold.

Among them, one person answered enthusiastically.

That was Masanori Higashiyama.

I asked a question, and he answered it properly.

I asked another, and he answered that one too.

The actual email exchange lasted only a few weeks, I think.

He was not the person who taught me the lighten composite itself.

I had already stumbled onto that method before then.

But when I tried to take it further as nightscape photography, he was the one who taught me what I did not know.

So in a sense, Masanori Higashiyama is my teacher.

He was a photographer of "urban nightscapes" — shooting stars from inside the city.

I was heading for the mountains.

The fact that we were not competing for the same work may have been one reason he was so generous with what he knew — though that is only my own guess.

And of course it was, before anything else, a matter of the kind of person he is.

It was only a few weeks, I believe.

But I do not think I will ever forget it.

Knowing the method did not mean I could take the photograph

I understood how the lighten composite worked.

Now I could take the photograph I wanted.

…That is not how it went.

If anything, the hard part started there.

What I wanted was not stars moving above a city skyline.

It was stars moving from dusk until dawn, above the ridgelines of the Northern Japan Alps.

There is no mains power up there.

In winter it is brutally cold.

And the camera has to keep working for hours.

In my first serious test, the battery lasted only two or three hours.

That was not the only problem.

The Nikon D3 had a limit of 130 frames in a single continuous burst.

In ordinary photography you almost never shoot 130 frames in a row.

So for most photographers it is not an issue at all.

But for someone who wants to keep making thirty-second exposures from dusk until dawn, it was a serious one.

In November there are up to about twelve hours in which you can photograph stars.

If you ran thirty-second exposures back to back for twelve hours, that is 1,440 frames in theory.

130 frames is nowhere near enough.

Solve one problem, and the next one appears.

If the battery won't last, build a power supply

In fact, dealing with camera power myself did not start with the D3.

It started back with the Nikon D1.

D1 batteries were expensive, and compared with today's cameras they were pretty unforgiving.

Winter mountains were especially hard.

There were times in midwinter when a fully charged battery I had carried up died after two or three frames.

At the time, some of the professionals using the D1 would take just the shell and terminals of an original battery, run a cable out of it, and power the camera from a 7.2V radio-control battery pack.

An RC battery cost around 2,000 yen back then, as I remember.

I did something similar.

With the D3, battery performance improved dramatically.

For ordinary shooting, you no longer needed any of that.

But what I was doing was not ordinary shooting.

I wanted to run a camera from dusk until dawn on a mountain below freezing.

Two or three hours was not enough.

In the end I built an external power supply from AA eneloop cells wired in series, and then those strings wired in parallel.

It kept working even when the cells themselves were frozen solid.

I once ran a camera for about fourteen hours in conditions close to minus thirty degrees Celsius.

Once I could shoot, the images were waiting for me

Solve the power.

Solve the continuous shooting.

Then, finally, you can shoot through the night.

And when you get home, a huge number of images is waiting.

Those early tests were nothing like today's volumes, but they were still in the hundreds.

Open an image in Photoshop.

Copy it.

Paste it into the composite image.

Stack it as a layer.

Open the next image.

Copy it again.

Paste it.

And repeat, endlessly.

Sometimes you put the same image in twice.

Sometimes you skip one.

When you notice a mistake, you have to work out how far back to go.

If an aircraft crossed the frame, you erase its trail by hand as well.

I kept doing this, on and on.

"If I keep doing this, my life will be over"

At some point I remembered a Leiji Matsumoto manga I had read long ago.

I can no longer recall which one.

I have a feeling it was Queen Millennia, but I am not certain.

Someone had been ordered to sort an enormous number of books.

Sorting them one at a time would take a lifetime.

So instead, build a machine that sorts books.

That is how I remember the story.

And I thought: is this not exactly what I am doing?

Rather than stacking hundreds or thousands of images with my own hands,

build the thing that does the stacking.

That is where I started writing software to automate the process.

What I wanted was not software

I automated the lighten composite.

Beyond simply joining the stars into lines, I also built a process that tapered the end of each trail so it looked like a meteor or a comet.

I called this "comet processing."

At the time that process was the software's main distinguishing feature, so I named the software itself "Comet."

I built what I needed on the shooting side too.

Build a power supply.

Build a way to keep shooting for hours.

Composite the huge number of resulting images.

Apply the comet processing.

Later I would even build a process that removed aircraft trails automatically.

But I did not want to do electronics.

I did not want a camera control device.

I did not want lighten-composite software.

What I wanted was none of those things.

What I wanted was a single photograph in which, on a ridgeline of the Northern Japan Alps, the stars keep moving from dusk until dawn.

To take that one photograph, the tools I needed did not exist.

So I built them.

That was all it was.

Digital Photo, April 2010: "Infinite Track"

I brought the photographs from that first serious test to Digital Photo.

They decided to run them.

But the first test alone did not give them enough work for a cover and a gallery.

So I went out to shoot again.

By that point, I think the automated lighten composite and the comet processing had come far enough to be used in actual work.

And then, in 2010.

In the April issue of Digital Photo, I published the mountain nightscape series "Infinite Track."

They used it not only in the gallery but on the cover.

I remember the editor-in-chief saying something to the effect of:

"It feels like being hit over the head with a hammer."

The lighten composite itself already existed in the world of astrophotography.

Higashiyama and others had been working with it before me.

Even so, I think it was not yet widely known as an approach in general photography.

Looking back, it may not have been only the compositing method — perhaps nightscape work shot over many hours deep in the mountains was itself unusual.

The magazine printed the camera and lens information, but not the heart of how the work was made — how many frames, composited how.

As I remember it, that was the editorial team's decision.

The aircraft I couldn't remove became "night noise"

Among the works in "Infinite Track" there is one called night noise.

At that time I was still erasing aircraft trails by hand.

On one frame, I did not finish before the deadline.

I ran out of time.

So I decided to make the light I could not remove part of the work itself.

That is how it came to be called night noise.

The name also carries a memory of a record I used to listen to.

In the 1980s I often played an LP called Nightnoise, released on Windham Hill Records.

Technically it was "the thing I failed to remove."

But the moment it had a title, it became part of the photograph.

From one magazine to PENTAX

Some time after the April issue of Digital Photo went on sale, the editor-in-chief called me.

Someone from PENTAX wanted to talk to me.

Was it all right to pass on my phone number?

That was the gist of it.

Of course, I said.

PENTAX got in touch afterwards.

I do not remember the exact words, but as I recall the message was something like:

"If you're going to shoot stars, we'd like you to shoot them with PENTAX. You have your relationship with Nikon, so you're welcome to keep using that as well."

The first PENTAX I used was the K-5.

That was the beginning of a long relationship between PENTAX and me.

I had not started shooting nightscapes in order to work with PENTAX.

I was stuck for a photograph to hand in at a Nikon photo school.

I wanted a headlamp trail to be a little longer.

Something that began with that small incident had, several years later, led to work with a different camera manufacturer.

You never know where life goes.

Finally meeting Higashiyama in person

I did eventually meet Higashiyama, the man who had helped me by email.

I am no longer clear on exactly when we first met face to face.

I believe it was before I began appearing at the PENTAX booth at CP+ myself.

It was probably in 2012, at his exhibition "Stars over the City" at Ginza RING CUBE, or at the talk event held then.

It is possible we had met even earlier.

I cannot say for certain.

What I do remember is meeting, years later, the person I had done nothing but pester with questions over email.

He went on photographing stars in the city, and I went on photographing them in the mountains.

The same lighten composite, but what we were photographing was quite different.

Even so, Comet was not a comfortable tool

I kept improving Comet for years afterwards.

Eventually I built a function that removed aircraft trails automatically.

It could also process images shot on different nights separately.

Once I was shooting around 5,000 frames a night, seven nights meant 35,000 frames.

At that scale, processing alone could take about ten days.

But that is not the same as ten days of manual work.

Once I started the processing, I did not need to be sitting at the computer.

I could leave it running and go out shooting for another ten days.

Sometimes I would come back from a shoot and it still was not finished.

Even so, it beat working through the frames one at a time by hand.

There were problems, though.

The aircraft-removal parameters in particular were very touchy.

Change a value slightly.

You want to see the result.

But the result arrives a day later.

If it is wrong, change it again.

And wait another day.

It did run automatically.

But at that point I learned something else as well.

Running automatically and being a good tool are not the same thing.

Sixteen years later, I am doing much the same thing

These days I develop software for photographers called Sidekick.

Sidekick Star, for nightscape photography, is one of them.

But Comet did not simply evolve into Sidekick Star.

They are different pieces of software.

There are things Comet had that Sidekick Star does not.

And the other way around.

So they are not a single product line running in a straight line.

Still, looking back, what I am doing has not changed much.

I think of a photograph I want to take.

I go out to take it.

I run into a problem.

I think about how to solve it.

If the tool I need does not exist, I build it.

And then I go out to shoot again.

That was true of the D1's battery.

It was true of the shooting control for mountain nightscapes.

It was true of Comet.

It is the same with Sidekick now.

I used to spend an absurd amount of time in front of a computer to finish one photograph.

Now I sometimes shoot around 5,000 frames in a night, but the way I process them is completely different from back then.

Part of that is simply that computers have become orders of magnitude faster.

But for me, the number that matters most is not the processing time.

While the computer is doing the work, the photographer can do something else.

You can sleep.

You can have a drink.

And above all,

you can go out and shoot again.

There is no need for a photographer to do work a computer can do.

Use that time to go and take the next photograph.

I think that is probably what I have been building tools for all along.

The Sidekick this story leads to