Sunday, July 26, 2015

Making a time-lapse on the command line using FFmpeg and ImageMagick

We’re vacationing in Whistler, BC right now as “endurance spectators” to my father-in-law’s 3rd Ironman triathlon. Expecting some beautiful landscapes and weather, I brought my newly acquired X100T to take some nice photos.

Yesterday, I set it up on an interval timer and pointed it right towards Rainbow Mountain, which faces the patio in the kitchen of the little condo unit we’re renting out. After all was said and done, I ended up with 400 images depicting clouds moving over a mountain peak and not much idea of what to do with them. So, as any self-respecting engineer would, I set out to create a time-lapse using only my trusty command-line tools: FFmpeg and ImageMagick.

Let’s get down to it.

Note: Everything in this tutorial assumes that you have a current copy of imagemagic and FFmpeg installed on your computer.

Resizing

Even though I turned off RAW on the X100T, the images were still pretty huge (4896x3264). During my first tests, making movies from images this large gave really inconsistent results and took a long time to create, with not much extra benefit.

Therefore, the first thing you should probably do is check the size of your images and, if necessary, resize them to be a bit smaller so they will play more nicely with FFmpeg and any other image manipulation that you’re going to do.

Since I planned to upload my video to YouTube, I referenced a handy page they have that lists out their preferred resolutions, codecs, and formats for upload (https://support.google.com/youtube/answer/1722171?hl=en). If you’re like me, and you don’t care too much about maintaining the current aspect ratio, here’s what you can do. This will resize your images to a preferred resolution (in this case, 1280x720), and will potentially crop off the sides or top in the process. To start, make sure you’re in the directory with all of your photos.

$ for FILE in `ls *.JPG`; do \
  mogrify -resize 1280x720^ -gravity center -crop 1280x720+0+0 +repage -write RESIZED_PHOTO_DIRECTORY/$FILE $FILE; \
done

In detail, this command -resizes photos to a 1280x720^ resolution (the caret means that the smaller of width and height is maintained and the larger one is kept even if the resolution is larger), and then, by using -gravity and centering, we crop the image to 1280x720 exactly, and write to RESIZED_PHOTO_DIRECTORY/$FILE. Phew, that was a mouthful.

If you just want to resize to a certain height/width and want to maintain the original resolution, just do this:

$ for FILE in `ls *.JPG`; do \
    mogrify -resize 600x -write RESIZED_PHOTO_DIRECTORY/$FILE $FILE; \
done

Maintaining Color Distribution

Note: this step might not be necessary in your situation, but it greatly improved the quality of the final product for me. YMMV.

Sometimes images captured in a time lapse have very different histograms (especially if you have auto-aperture / shutter-speed enabled), and this can make things look “jumpy” from frame to frame. Obviously, this won’t look great in your final video, so we’re going to normalize the colors to a set distribution.

For an example, just compare the following two images (especially notice the trees, which are much lighter in the first example than the second):

Not ideal, right?

To help achieve this end, I used an ImageMagick script called histmatch, generously provided by Fred Weinhaus (link: http://www.fmwconcepts.com/imagemagick/histmatch/index.php). The idea to use a reference image to generate a histogram that we want all of the other images to match. Once you’ve decided on your reference image, run the following on every image except the reference image (otherwise the universe will explode).

$ histmatch -c gray REFERENCE.JPG TARGET_IMAGE.JPG NORMALIZED_IMAGE_DIRECTORY/FILE.JPG

(I just piped the output of ls *.JPG into a file called normalize.sh and used some of my Vim-fu to do this. Your process might be different.)

Finally, make the darned movie

This is the fun part. Just send the files through to FFmpeg and have it do its magic. If filenames are incrementally named, you’ll want to provide the parameters below (like -start_number and the _DSF%04d.JPG format) to make things match up.

$ ffmpeg -start_number 1 -i _DSF%04d.JPG -c:v libx264 -pix_fmt yuv420p video.mp4

This tells FFmpeg to take all of the JPEGs in the directory starting with _DSF and ending with 4 digits, and to output an h.264 video with the yuv420p colorspace to video.mp4. You now have a beautiful timelapse!

If you’re interested in the final product, you can check it out on YouTube. Enjoy!

Monday, June 8, 2015

Post-WWDC 2015 Keynote Thoughts

It’s now been a few hours after The WWDC 2015 Keynote, and I’ve had some time to digest everything. My immediate impression of everything was a little “meh”, but then again, that’s sort of how I feel every year. It’s hard to satisfy everyone.

Second impression is that the WWDC Keynote is no longer for developers. It’s for the end users and wannabe developers. Us old-timers are too jaded to care about this new and shiny stuff, and most of the new products in the keynote aren’t even things developers can use (on that note, was it really necessary to spend that much time on Apple Music?).

Another noteworthy thing–no new hardware. I was expecting at least something, so to hear crickets was a little unfortunate. I can only assume that the inordinate amount of time spent talking about Apple Music was in some part due to a need to “fill time” from what would have originally been a 15-20 minute spiel on Apple TV.

As always, the things that are exciting to me happen in the sessions throughout the week. The Keynote is sort of just a preview of what’s to come. After some perusing through the documentation, here’s what I’m excited about:

Deep Linking

I wrote about this in my WWDC 2015 Wishlist, and it came true. You can now link up URLs to be opened by your application. I haven’t had too much time to play around with iOS 9 yet, so I’m not sure how this works from either the developer or end-user side of things, but my first impression is that Apple did this right.

Besides the notable backtracking of moving search away from the pull-down gesture and back to the left of the home screen (I would have loved to be a fly on the wall in that meeting), iOS Search can now display search results straight from apps in Spotlight.

Just to illustrate an example—my company writes an app called Tweet Seeker that lets people download their Twitter archives and search their tweets locally on their device. Tweet Seeker can now hook right into iOS and display tweet search results right from Spotlight. Now that’s cool!

iPad Multitasking

Remember the iPad Pro? Well, this is it. You take a regular iPad, and you install iOS 9. There. iPad Pro. :claps:

You know those things that you can’t really imagine a use for, or want, and then in 3 months you realize you can’t live without it? Yeah, well, I’d put money that this is one of those things.

I can see this changing how people use their iPads, along with the new keyboard gestures. The iPad is no longer just a toy, or larger screen iPhone made for watching Netflix and HBO. It’s now a tool to get shit done.

Swift 2

I think it’s great news that Swift is going open source “later this year”. Of course, in Apple parlance, that means probably somewhere around December 15-31 (just trying to be realistic here–it’s not easy to open-source something like this, I’d bet there is a ton of proprietary code lurking in that codebase).

Also, I think with this release, I’m comfortable picking up the Swift book and starting to actually learn the language. I am embarrassed (only a bit, though) that I haven’t written a single line of code in the language. With this latest release, I think I might be ready to start jumping in. A 2.0 implies a little more stability, and other developers who were waiting on the sidelines will probably jump in on the fun as well.

Another telling thing is that all the code I saw in the “Developers State of the Union” Keynote was written in Swift. I don’t think it’s any secret now that Apple considers Swift to be the future. As much as we might not want it, it’s going to happen.

If you started learning it a few months ago, though, prepare to have to relearn a bunch of stuff. I wouldn’t be surprised if Apple pulled the rug out from under you.

Apple Music

I’ll keep it brief. I don’t need it. Spotify works great for me. I think its success hinges on musicians buying in. We don’t want another Ping here.

Conclusion

You’ll notice I skipped over a lot of the OS X stuff. I honestly haven’t had enough time to digest it all. So. Much. New. Stuff. Will download and report back.

That’s it for now. I’m taking a walk to think about this all some more.







Wednesday, June 3, 2015

WWDC 2015 Wishlist

Here’s my list of things I’d be overjoyed to see fixed / announced / released at WWDC 2015 next week.

iOS

  • Deep linking support. Let apps define associated URLs (https://twitter.com/* –> open Twitter.app).
  • Really want to hide my carrier and clean up that status bar. Such a mess right now.
  • It’s time to modernize the UI for Notes.app and Reminders.app. iOS 6 was years ago.
  • Save alarm and world clock data in iCloud. Re-adding this on every device is really tedious.
  • Export Health.app data or save it in iCloud with a password. At the moment, it’s not shared between devices and will be lost permanently if you don’t have an encrypted local iTunes backup of your device.
  • Needs to be a way to close all tabs in Safari without tapping the screen 50x times. Absurd.

Mail.app

  • Search that actually works. Right now this is the only reason I still have the Gmail app still on my phone. I open it up whenever I want to search for a message.
  • Send from an alias like Gmail web client lets you.
  • Better UX for labeling threads.

Maps

  • (I’ve mentioned this on Twitter) Fix the UX with reviews of physical locations.
  • Public transit support.
  • Improved traffic data.

App Store

  • Search. Need I say more?
  • Direct refunds without iTunes support involvement.
  • Responding to reviews would be nice.
  • Expire old reviews (1yr+) when new versions of app have since been released.

Safari (OS X)

  • Reopen more than the most recent closed tab in Safari.
  • Paste images into web pages.

Xcode

  • Stop beachballing so darn much.
  • It would be nice to stop an archive action without needing to restart the app.
  • Debugging extensions is currently a huge pain. It would be nice if it were easier.

Added 6/7/2015

Photos on OS X

  • “Show in Finder”

Sunday, March 29, 2015

The Free, Easy, and Secure Way to Encrypt Shared Dropbox Folders on Your Mac

My wife and I have been searching for months for a service to allow us to store our sensitive files in Dropbox securely. There are a lot of services out there that promise to do this well, but frankly, it’s hard to trust that our data would be safe if they happened to be hacked or compromised. I therefore went looking for a piece of software that was:

  1. Vetted as being secure.
  2. Ubiquitous. Something I wouldn’t need to worry about installing or finding on a future machine.
  3. Compatible with Mac OS X.

TrueCrypt, an open-source file encryption product, seemed like it might fit the bill. However, I must have had my head in the sand about a year ago (sure enough, I was off the grid when it happened), but TrueCrypt was abandoned by its developers with a very vague / scary message on their website:

WARNING: Using TrueCrypt is not secure as it may contain unfixed security issues

Ok then. So that in itself wasn’t reason enough for me to give up. I went ahead and downloaded TrueCrypt from some random site and verified the checksum (remind me which of my family is going to know how to do this?) and installed it (in order to do this, I had to temporarily disable OS X’s protection against unsigned software in “Security & Privacy” in System Preferences).

That’s a lot of steps for someone who just wants to share encrypted files. And more steps are bad—I didn’t want people I’m sharing stuff with to just give up. We’d be back to square one.

Not to mention, TrueCrypt doesn’t offer dynamically sized volumes. You have to specify the size of the volume at the time of creation. This means that if the number of files in a volume you’re sharing hits the limit—too bad. You need to now create a new volume (one with a larger limit) and move all of the existing files from the previous volume into it. That’s a drag. And sort of dumb.

Off I went looking for an alternative. “Wait”, I thought, “doesn’t OS X provide full-disk encryption via FileVault?”. Well, I didn’t actually ask myself that, but I concluded that there must be a way to do this just using a stock Mac OS X installation.

Sure enough, after some digging, I found this on Apple’s support site: How to create a password-protected (encrypted) disk image. Boom! There we have it.

If you follow the instructions (which are quite simple, really), you’ll have a “file” (which is actually a “sparse image”—sort of like a Volume) which you can drop into a shared Dropbox folder and share with anyone you want. To add or remove files to the encrypted folder, you need to double click it, type in the password, and then open it like you would any other volume (like your Hard Drive or a USB stick). Once you’re done modifying files, just “eject” it. Easy peasy. Dropbox syncs it immediately.

Oh—and the folder resizes automatically! Another huge plus over TrueCrypt.

So, in short, you can create an AES-encrypted folder, inside your Dropbox, and anyone else who uses a Mac will be able to add or remove files from it without needing to install any third-party software. And, it’s free.

Go forth and encrypt!

P.S. Windows users might have similar luck with BitLocker.

P.P.S. Jamie Phelps pointed me to this AgileBits article regarding a downside of using sparse bundles and Dropbox (note–a sparse image and a sparse bundle are not the same thing, so the two may not have the same downsides). Knox stores its vaults with OS X sparse bundles, and those have been shown to have issues syncing over Dropbox when simultaneous edits are made. I’ve yet to see this be a problem with using sparse images (since OS X—and Dropbox—treats a sparse image as a single file), but it might be an issue. Jamie recommends SafeMonk as an alternative.



View the rest of the archives