The Apple WWDC 15 session video on AV Foundation shows there are new features for developers who want to manipulate QuickTime movies on the Mac.
Some notes from the video:
New version of AV Foundation provides new classes for applications to edit QuickTime movie files.
Open QuickTime movie files and perform range-based editing on movies in tracks.
You select a segment of a movie and copy it into some other movie.
Add and remove tracks (tracks in QuickTime can refer to any time-based information, such as subtitles, GPS info, camera metadata)
Associate one track with another – such as saying that this track is the chapter break information for that track.
Add or modify movie and track metadata.
Create movie files and URL sample reference movie files.
‘QuickTime movie’ means data in a file that conforms to the QuickTime movie file format or ISO base media file formats that were based on QuickTime such as MPEG-4.
Sample data (audio and video content) can be in files separate from the QuickTime movie.
Movies that reference external media are ‘fragile’ – if the media is deleted or moved, the movie cannot play.
AV Foundation can now update an existing movie file without worrying about the sample data. That means edits, tracks and metadata can all be changed if the samples stay the same – “In place editing” (URLs in the context of AV Foundation are usually describe the location of files in connected storage)
A example project that shows how an application can combine many gigabytes of footage with metadata.
Good news for post production people who need developers to make applications that support complex workflows, and for those that hope existing tools will get useful new features.
Most understated 10.11 feature here is “edit in place”. No longer have to re-export entire file for trivial change. http://t.co/jqmjlnVTWU
— Digital Rebellion (@digitalreb) June 11, 2015
Digitial Rebellion are the makers of Pro Media Tools for Final Cut Pro, Avid and Adobe software.
Before AV Foundation QuickTime libraries in older versions of OS X were able to manipulate QuickTime reference movies. These were small files that were able to represent complex edits of multiple external media files. Reference movies are much simpler to work with that gigabytes of video and audio footage.
Maybe it’s time to do a quick course in Swift so you can make your own post production OS X applications!
Note that the screenshot shows that these new features are OS X Capitan only (the OS X logo in the top right of the screen). Once they’re available on iOS, tools for iPhones and iPads will be able to do much more with movie files.
Autodesk Smoke 2016 includes improved support for Final Cut Pro X XML export.
Although Smoke can use other formats for export, the new help file says out that Final Cut’s format is the one to use for collaboration:
Use FCP X XML Export when you want to share a sequence with third party applications.
The XML Export generates a simplified sequence that can be used in third party applications for creative editorial, color correction, media management, etc.
There are new Sequence Publish presets available, which output FCP X XML sequences.
- XML for DaVinci Resolve for Source Grading (ProRes 422 and 24-bit WAVE)
- XML for DaVinci Resolve for Source Grading (Sequence-only)
- XML for DaVinci Resolve (ProRes 422 and 24-bit WAVE)
Smoke 2016 can also now conform Final Cut Pro X timelines that include MXF format clips.
Shout out to @finalcutproes for the link!
Brian Mulligan pointed out:
#AutodeskSmoke 2016: You can now import, export, and use for media cache (intermediates) Apple ProRes 4444 XQ for high dynamic range content
— @BKMeditor June 11, 2015
Looks like Autodesk also likes Apple’s ProRes 4444 XQ.
Don’t believe Final Cut Pro X or Adobe Premiere will run on iOS one day? Apple’s Metal for iOS might be the key.
As Metal originated in iOS does this mean that there is the potential to run ‘serious’ applications, such as MODO, NUKE or even MARI on an iPad one day?
Anything is possible. Having a common graphics API between the two is certainly a start. What is maybe more interesting is a WYSIWYG workflow between IOS and OSX. You could use your Mac to design assets in MARI / MODO / NUKE and then have them display / rendering live on a mobile device looking exactly the same.
Using the iPad’s accelerometer, Foundry tools might be able to render graphics as AR overlays.
Jack also appeared on stage at the Apple WWDC conference this week – 10:58 into the video at developer.apple.com. He showed how much The Foundry team were able to achieve in four weeks of adding Metal to MODO, their 3D modelling and animation application.
If you don’t want to transport computers and cameras in aeroplane hold luggage, you may need to buy new carry-on bags.
Airlines are changing the rules because too many passengers bring the the maximum size luggage. New worldwide rules:
The recommendation by the International Air Transport Association suggests an “optimal” carry-on size at 21.5 inches (55cm) tall by 13.5 inches (34cm) wide by 7.5 inches (19cm) deep. That’s smaller than the current maximum size allowed by many airlines.
The new recommendation is 56% of the current volume of the British Airways allowance of 22 inches (56cm) tall by 18 inches (45cm) wide by 10 inches (25cm) deep.
Apple has changed the corporate definition that they include in their press releases:
Apple revolutionized personal technology with the introduction of the Macintosh in 1984. Today, Apple leads the world in innovation with iPhone, iPad, the Mac and Apple Watch. Apple’s three software platforms — iOS, OS X and watchOS — provide seamless experiences across all Apple devices and empower people with breakthrough services including the App Store, Apple Music, Apple Pay and iCloud. Apple’s 100,000 employees are dedicated to making the best products on earth, and to leaving the world better than we found it.
Pity the grammar is a little off. Shouldn’t it be “leaving the world better than they found it”?
Compare this new definition with the way Apple described itself last week – which had remained unchanged for over three years – since January 2012:
Apple designs Macs, the best personal computers in the world, along with OS X, iLife, iWork and professional software. Apple leads the digital music revolution with its iPods and iTunes online store. Apple has reinvented the mobile phone with its revolutionary iPhone and App Store, and is defining the future of mobile media and computing devices with iPad.
Apple’s mission in 1995:
Apple Computer, Inc., a recognized pioneer and innovator in the information industry, creates powerful solutions based on easy to use personal computers, servers peripherals, software, online services and personal digital assistants. Headquartered in Cupertino, California, Apple Computer, Inc. (NASDAQ: AAPL) develops, manufactures, licenses, and markets products, technologies, and services for the business, education, consumer, scientific & engineering and government markets in over 140 countries.
A corporate definition that could apply to almost any tech company back then – apart from the mention of PDAs.
I’ve written previously about how this definition changed between 1995 and 2012.
Credit to noticing Monday’s change goes to UK-based Mac journalist Lucy Hattersley.
Here’s my take on the announcements at the Apple Worldwide Developer’s Conference 2015.
First came details on the next version of OS X, named El Capitan. El Capitan is one of the mountains in the Yosemite National Park in California. This naming is smiliar to how OS X Mountain Lion came after OS X Lion and OS X Snow Leopard came after OS X Leopard. It signals that this update isn’t as big from users point of view. OS X Mountain Lion, Snow Leopard and El Capitan have less big new features that most Mac users will get excited about.
These updates give developers that chance to catch up on new Apple technologies and Apple the chance to introduce innovations that developers can use to do new things. An example could be that if Apple have added more features to AV Foundation, the code that lets application developers (inside and outside of Apple) to do more with movies and audio. Apple Marketing won’t tell the public about AV Foundation updates this year, but will hope that new OS X (and iOS watchOS) abilities will mean better AV applications in the coming months.
El Capitan adds natural language searches “The pictures I took last year in London.” This should also work for searches based media metadata, and eventually metadata added within applications such as Final Cut Pro X: “Select favourites from the second half of the concert in Manchester featuring the drummer and the bass guitarist shot on a GoPro.” Apple haven’t yet announced links between media metadata and Spotlight searches, but natural langauge searches in iMovie and Final Cut Pro X would be useful.
In iOS apps can make their content available to Spotlight so that an iPhone- or iPad-wide search will find content in a specific part of the app.
[20:30 into main keynote] Last year Apple introduced Metal – a way for iOS gaming applications to better access the power of iPhone, iPad and iPad CPUs and GPUs. Last year the emphasis was on how this would make iOS games better. This year Apple had a demo of how well a game worked with Metal on OS X.
Metal has also evolved to speed up more of OS X. In El Capitan Metal improves the speed of Core Animation and Core Graphics. Compared with when these libaries executing OpenGL commands, they now render ‘up to’ 50% faster on the same hardware.
[21:20] Interestingly for post production people, Apple also said how Metal would speed up ‘high performance apps.’ It does this by replacing OpenGL graphics code and OpenCL distributed processing code (for sharing work between CPUs).
[21:45] The first developer story of the WWDC keynote was from Adobe. They’ve been able to speed up After Effects CC rendering by 8x using Metal for OS X. Animations can be rendered in real time. Instead of waiting for Illustrator CC to rerender complex graphics when zooming, now rendering happens in real time. This brings the power of interactive graphic changes – no waiting for rendering in Illustrator.
“We are committed to adopting Metal on our OS X apps. With performance increases of up to 8x, we are excited about what Metal can do for our Creative Cloud users.” – David Wadhwani, Sr. VP & GM, Digital Media, Adobe [22:08]
David McGavran of Adobe Systems demoed the speed improvements in After Effects CC and Illustrator CC during the ‘Platforms State of the Nation’ session [1:32:15 into this video]. He said that Adobe apps like Premiere Clip already benefit from Metal on iOS.
“Pro app makers are seeing the benefits of Metal like The Foundry and Autodesk. I think were going to see pro users, gamers and all of us benefiting from the performance advantages of Metal” Craig Federighi, Apple [26:55]
AV Foundation is the part of OS X (and iOS) that applications use to manipulate video and audio. The Editing Movies in AV Foundation developer session has the following description:
Learn how to use the new AVMutableMovie class to modify media files and simplify your editing workflows. See how to support segment-based editing and discover the power of sample reference movies.
The developer documentation for the version of AV Foundation in El Capitan hasn’t yet been updated to include AVMutableMovie.
According to Pedro Santamaría on Twitter, the current version Final Cut Pro X runs faster on his 2012 MacBook Air – as tested using my BruceX benchmark:
— Pedro Santamaría (@cuxtom) June 9, 2015
This is impressive given that operating system betas aren’t tuned for speed. I’ll add any update he gives on how much faster the Mac Pro is running El Capitan.
In each keynote Apple likes to show slides that list ‘too many features to go into right now.’ Some that are relevant to post production are:
File copy resume – could mean that the Finder (or other applications) will resume copying files after a crash or other interruption
Photos editing extensions – could be possible to make changes to photos within video and motion graphics applications. No ‘Movie editing extentions’ yet
Airplay Video – OS X users can already play videos on Apple TVs on the same network, perhaps this mention means that other Macs will be able to play back video.
No. Not today.
Unless you are developing Mac software. Although Apple hope it won’t cause any problems on your Mac, it wouldn’t suprise exprienced developers if a fault wipes all hard drives. At the moment there are reports ranging from “No problems” to “Final Cut Pro X crashes constantly.” If you must try it, I suggest you wait for the version Apple releases as part of its public Beta programme.
As regards compatibility, if a Mac can run OS X Yosemite today, it will be able to run the release version of OS El Capitan tomorrow.
Other keynote announcements show that Apple want to maintain and create new ecosystems. As well as supporting big players, their ecosystems include support for small companies and individuals to do well. This makes sense to iOS and OS X developers selling through Apple’s App Stores.
As well as adding more banks and the UK to Apple Pay, Apple mentioned that Square will soon introduce a terminal that will allow anyone to accept ApplePay payments.
The News iOS app is a place for syndicated content from news and media organisations. Apple is also considering content from smaller sites and individuals. For now they need to set up an RSS feed of their stories and apply to Apple stating which kinds of content they create:
News brings together high-quality news, magazine, and blog sources in a single beautiful content experience. Whether you’re a major news organization or an individual blogger, you can sign up to deliver your content to millions of iOS users.
Topics are created and assigned by Apple’s expert editors and sophisticated algorithms.
News Publishing Guide – Apple
This means that if you can demonstrate that you provide relevant content on a subject of interest to just a few thousand people, Apple’s News app might be able to help you connect with the iOS users amongst them.
As well as being able to monetise your content with 100% from any advertising you include, you optionally get 70% of income from Apple’s iAd system.
During the launch of Apple Music, Apple made a point of including unknown musicians. As well as being able to have their music included in Apple Music, Connect helps them maintain their community of fans by adding text, audio, pictures and video to their Apple Music page. Apple Music also takes into account how individuals within families have different music preferences by offering a good value family plan.
At the moment Apple’s Beats 1 worldwide radio station seems aimed at a limited demographic – those interested enough in current and new music to want to hear well chosen music. Those willing to pay for a music subscription. Hopefully Apple will be able to create more advanced radio experiences in future.
This prompts the question of where video, TV and film fits into Apple’s plan. If Apple is consistent with what they are about to do with News and Music, people, small groups and large content creators will be able to share their video content in the same way.
If Apple Movies was built in the same way, there would be an iOS application which would provide a single place to consume and discover video content. It would combine human curation with algorithms that would learn your preferences. If you are a producer, Apple would provide simple tools to make your content available (News) and build audiences (Apple Music Connect).
A similar ecosystem could be built around podcasts – perhaps supported by a worldwide Apple radio station that features presenters and excerpts from podcasts, audio books and radio drama.
The Apple Music family plan prompts me to point out that some media – music, TV, movies – is fun to share with others. Perhaps Apple should find a way for software to create combined streams that would entertain groups of people: A family playlist for everyone until 10pm, then content for the parents. “Stick with this 15 minute short that only your brother likes, something you really like will be on next.” This could work for any group of people – including groups not gathered in one place: hanging out across the internet.
If your media has to fit in a shared customised stream, the methods you use to tell stories might change.
If Google and Apple will eventually meet in a battle of software on hardware vs. software in the cloud, Apple might need to change the field of battle. If hardware devices become so ambient as not needing to be associated with an individual – apart from an earpiece running Siri – Apple’s hardware integration edge will become irrelevant. What survives will be Apple’s ability to maintain and support media ecosystems.