{"id":1031,"date":"2022-08-31T11:46:12","date_gmt":"2022-08-31T18:46:12","guid":{"rendered":"https:\/\/www.docbug.com\/blog\/?p=1031"},"modified":"2022-08-31T11:47:11","modified_gmt":"2022-08-31T18:47:11","slug":"using-dall-e-on-video","status":"publish","type":"post","link":"https:\/\/www.docbug.com\/blog\/archives\/1031","title":{"rendered":"Using DALL-E on video"},"content":{"rendered":"\n<p>Director Karen X. Cheng just posted a cool video where she uses OpenAI&#8217;s <a href=\"https:\/\/openai.com\/blog\/dall-e\/\">DALL-E<\/a> to generate different outfits and then applies them to a video of her walking down the street. DALL-E is designed for images, not video, so after generating the individual key frames she used the (currently free) program <a href=\"https:\/\/ebsynth.com\/\">EbSynth<\/a> to map those keyframes to the video and then <a href=\"https:\/\/github.com\/baowenbo\/DAIN\">DAIN<\/a> to smooth it out.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\"><p lang=\"en\" dir=\"ltr\">1\/ Using AI to generate fashion<br><br>After a bunch of experimentation I finally got DALL-E to work for video by combining it with a few other AI tools<br><br>See below for my workflow &#8211;<a href=\"https:\/\/twitter.com\/hashtag\/dalle2?src=hash&amp;ref_src=twsrc%5Etfw\">#dalle2<\/a> <a href=\"https:\/\/twitter.com\/hashtag\/dalle?src=hash&amp;ref_src=twsrc%5Etfw\">#dalle<\/a> <a href=\"https:\/\/twitter.com\/hashtag\/AIart?src=hash&amp;ref_src=twsrc%5Etfw\">#AIart<\/a> <a href=\"https:\/\/twitter.com\/hashtag\/ArtificialIntelligence?src=hash&amp;ref_src=twsrc%5Etfw\">#ArtificialIntelligence<\/a> <a href=\"https:\/\/twitter.com\/hashtag\/digitalfashion?src=hash&amp;ref_src=twsrc%5Etfw\">#digitalfashion<\/a> <a href=\"https:\/\/twitter.com\/hashtag\/virtualfashion?src=hash&amp;ref_src=twsrc%5Etfw\">#virtualfashion<\/a> <a href=\"https:\/\/t.co\/x3zP3fIp4G\">pic.twitter.com\/x3zP3fIp4G<\/a><\/p>&mdash; Karen X. Cheng (@karenxcheng) <a href=\"https:\/\/twitter.com\/karenxcheng\/status\/1564626773001719813?ref_src=twsrc%5Etfw\">August 30, 2022<\/a><\/blockquote><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script>\n<\/div><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p>She has more interesting experiments with DALL-E, AR and video processing over at her <a href=\"https:\/\/www.instagram.com\/karenxcheng\/\">Instagram<\/a>.  (h\/t to <a href=\"https:\/\/boingboing.net\/2022\/08\/30\/using-dall-e-to-generate-fashion.html\">Boing Boing<\/a>)<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Director Karen X. Cheng just posted a cool video where she uses OpenAI&#8217;s DALL-E to generate different outfits and then applies them to a video of her walking down the street. DALL-E is designed for images, not video, so after generating the individual key frames she used the (currently free) program EbSynth to map those [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[23,5],"tags":[],"class_list":["post-1031","post","type-post","status-publish","format-standard","hentry","category-machine-learning-ai","category-media-technology"],"_links":{"self":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts\/1031","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/comments?post=1031"}],"version-history":[{"count":1,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts\/1031\/revisions"}],"predecessor-version":[{"id":1032,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/posts\/1031\/revisions\/1032"}],"wp:attachment":[{"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/media?parent=1031"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/categories?post=1031"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.docbug.com\/blog\/wp-json\/wp\/v2\/tags?post=1031"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}