AUTOMATIC CHROMA KEY BACKGROUND GENERATOR

Description

CROSS-REFERENCE TO RELATED APPLICATION(S)

[0001] This application claims the benefit of U.S. Patent Application No. 14/248,212, entitled AUTOMATIC CHROMA KEY BACKGROUND GENERATOR WITH INCIDENT KEY LIGHTING and filed on April 8, 2014.

TECHNICAL FIELD

[0002] Various exemplary embodiments disclosed herein relate generally to video production. Specifically, exemplary embodiments relate to lighting control for video effects.

BACKGROUND

[0003] Chroma key depositing (i.e., chroma keying) is a technique used in image and video production to produce a composite image. A portion of a target image including a subject is replaced with another image; in order to ease the replacement of the portion of the target image, that portion is "keyed" with a single color that is distinguishable from the rest of the image and is replaced with the second image. During video production, a solid green or blue (to be furthest away from natural skin tone) are used as background. During post-production the background color is replaced with another background to produce the composite image.

[0004] Recently, solid matte backgrounds have been replaced with light-emitting diode (LED) array lighting systems. Some LED systems replace existing lights, such as LED-mounted spotlights or on-camera flashes. In some instances, LED arrays have also been used as background to supplement or even replace a chroma key background for a composite image. However, unless the LED array is emitting the same color as the chroma key background, the LED array must be completely out of the camera's field of vision in order for the post-production processing of the chroma key background to be effective.

[0005] In view of the foregoing, it would be desirable to incorporate LED lighting arrays in chroma key images and videos. In particular, it would be desirable to use LED lighting within a camera's field of vision in chroma key video capture. Document US8264468 discloses a camera based touch input system comprising a chroma-key/matte display.

SUMMARY

[0006] In light of the present need for controlled chroma key and incident lighting, a brief summary of various exemplary embodiments is presented. Some simplifications and omissions may be made in the following summary, which is intended to highlight and introduce some aspects of the various exemplary embodiments, but not to limit the scope of the invention. Detailed descriptions of a preferred exemplary embodiment adequate to allow those of ordinary skill in the art to make and use the inventive concepts will follow in the later sections. The invention relates to a video and lighting control apparatus according to claim 1.

[0007] Various embodiments relate to a light control apparatus for controlling a lighting device. The light control apparatus can include a lighting device comprising a viewed portion of lights and an unviewed portion of lights and a light control circuit that controls the viewed and unviewed portion of the LED array based on a controlled lighting sequence. The controlled lighting sequence can include an ambient light profile. In various aspects, the controlled lighting sequence also includes a chroma key color profile and/or an incident light profile.

[0008] In various aspects, the lighting device can include an LED array and/or a projector. In various aspects, the light control apparatus can also include a video capture device that records a first image, wherein only the viewed portion of the lighting device is in a field of vision of the video capture device. In an aspect, the lighting device can include one or more spotlight lighting sections that display the incident light profile.

[0009] In various aspects, the light control apparatus can also include a sensor that records light measurements, wherein the light control circuit determines the field of vision of the image capture device based on the light measurements. In various aspects, the light control apparatus can also include a user interface connected to the light control circuit that sends signals to the light control circuit to modify the controlled lighting sequence. In an aspect, the lighting control circuit generates the incident light profile based the light measurements.

[0010] In various aspects, the light control apparatus can also include an image storage device that includes at least a reference image. In various aspects, the light control apparatus can also include an image processing circuit that generates a composite image based on the first image and the reference image. In an aspect, the image storage device stores images associated with a target GPS coordinate.

[0011] In various aspects, the light control apparatus can operate such that at least the viewed portion of the lighting device displays a chroma key color and/or emit infrared light. In an aspect, only the viewed portion of the lighting device displays the chroma key color and/or emits infrared light.

[0012] In various aspects, the light control apparatus can operate such that the unviewed portion of the lighting device displays the ambient light profile. In an aspect, only the unviewed portion of the lighting device displays the ambient light profile. In various aspects, the light control apparatus can operate such that the lighting device alternates between displaying the chroma key color and/or infrared light and the ambient light profile.

[0013] It should be apparent that, in this manner, various exemplary embodiments enable automatic chroma key and incident lighting. Particularly, by controlling individual lights within a lighting device for the filming period, the apparatus enables users to capture images using both chroma key lighting and ambient and incident lighting within the same recording period.

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to better understand various exemplary embodiments, reference is made to the accompanying drawings wherein:

FIG. 1 illustrates a block diagram of an exemplary light control apparatus;

FIG. 2 illustrates an exemplary light-emitting diode array;

FIG. 3 illustrates an exemplary image employing an embodiment of the light control apparatus; and

FIG. 4 illustrates a flowchart for lighting a scene using an embodiment of the light control apparatus.

DETAILED DESCRIPTION

[0015] Referring now to the drawings, in which like numerals refer to like components or steps, there are disclosed broad aspects of various exemplary embodiments.

[0016] FIG. 1 illustrates a block diagram of an exemplary light control apparatus. Light control apparatus 100 can be used, for example, in image or video production to aid a user in making composite images and/or videos. Light control apparatus 100 can include a light control circuit 102, a lighting device 104, a user interface (UI) 106, a display 108, a bus 110, an image capture device 112, a sensor 114, an image processing circuit 116, and/or an image storage device 118. In some embodiments, multiple elements can be components in a single device. For example, image capture device 112, sensor 114, and display 108 can be in a single device, such as a digital video recorder. Similarly, light control circuit 102, user interface 106, and display 108 can be included in a single device.

[0017] Light control circuit 102 can include hardware to control each light in lighting device 104. In some embodiments, light control 102 can control multiple, discrete lighting devices 104 (not shown) in concert. Light control circuit 102 can send signals to control lighting device 104 via wired or wireless connection. Light control circuit 102 can control the functioning of each light in lighting device 104 through a controlled lighting sequence, which programs light characteristics of each light in lighting device 104 over a set period. Some light characteristics include, for example, the light plot (i.e., positioning of lights in a scene), color, focus, duration, brightness, quality (e.g., hard or soft), etc. In some embodiments, light control circuit 102 can receive feedback from sensor 114 and use the feedback to set light characteristics for lighting device 104.

[0018] In some embodiments, light control circuit 102 can include software to control characteristics of individual lights or light groups within lighting device 104. For example, light control circuit 102 can treat a light group as a skeuomorphic "spotlight", with the light group within lighting device 104 treated as a single entity with all the light characteristics of the group being controlled in tandem. In some embodiments, a user can select individual lights within lighting device 104 to control through light control circuit 102.

[0019] During operation, light control circuit 102 can receive a controlled lighting sequence either through user interface 106, or from image storage device 118 (e.g., database, video recording device, hard drive, etc.) via bus 110 and can use the controlled lighting sequence to control each light in lighting device 104 during a set period. In some embodiments, light control circuit 102 can generate and/or modify the controlled light sequence. The controlled lighting sequence can include one or more lighting profiles, such as a chroma key profile, an ambient light profile, and/or an incident light profile. The controlled lighting sequence can, for example, set and modify light characteristics of specific lights or light groups during filming to mimic different landscapes and can help light a subject correctly while the subject moves within the scene. For example, the viewed portion can display a chroma key profile, the unviewed portion can generally display an ambient light profile, while specific light groups in the unviewed portion can display an incident light profile. In some embodiments, light control circuit 102 receives feedback from one or more sensors 114 and can change light characteristics of one or more lights based on the received feedback.

[0020] In some embodiments, light control circuit 102 can determine the viewed and unviewed sections of lighting device 104. For example, light control circuit 102 can receive signals from one or more sensors 114 that can be used to determine the field of vision of image capture device 112. In such instances, light control circuit 102 can set the viewed section of lighting device 104 to correspond with only the lights that are in the field of vision of image capture device 112. Light control circuit 102 can also set all the lights outside of the field of vision of image capture device 112 as the unviewed section of lighting device 104. Light control circuit 102 can set specific light characteristics for specific sections of lighting device 104. For example, light control circuit 102 can set the viewed section of lighting device 104 to display a monochromatic, chroma key color, such as green or blue, while setting the unviewed section of lighting device 104 to display programmed ambient light or incident light, such as simulating sunlight through moving cloud cover.

[0021] In some embodiments, light control circuit 102 can change light characteristics of lighting device 104 based on image capture device 112. For example, if image capture device 112 is a film camera shooting at 48 frames per second (fps), light control circuit 102 can alternate characteristics of all lights in lighting device 104 between a chroma key color and a plurality of colors to simulate ambient light. When light control circuit 102 changes the lights this way, half of the filmed frames are filmed when lighting device 104 is displaying the chroma key color, while the other half of the scenes are filmed using the ambient light profile stored in the controlled lighting sequence (thus lighting the subjects using simulated ambient light). This enables a user to generate a composite image using ambient light on the subject, as the user can use the chroma key images to insert a new background in the chroma-keyed images while using the ambient light images to light the subject using the correct lighting profile. In some embodiments, light control circuit 102 can use genlocking to synchronize image capture device 112 and lighting device 104.

[0022] In some embodiments, light control circuit 102 can generate a controlled lighting sequence based on images it receives. In some embodiments, light control circuit 102 can receive one or more high-resolution images via bus 110 from image storage device 118 and can generate light characteristics for lighting device 104 to emulate the profile of the received images. For example, light control circuit 102 can receive images of a harvest moon sky and a moon-lit ground. Light control circuit 102 can generate a controlled lighting profile for sections of lighting device 104 such that lights in lighting device 104 above the subject emulate the sky, while lights in lighting device 104 below the subject emulate the ground.

[0023] In some embodiments, a user can modify the generated profile to control individual lights or light groups. For example, a user can edit the controlled lighting profile to change the color, intensity, and/or focus of the light to better light a subject in a simulated night scene. In some embodiments, light control circuit 102 can control lighting device 104 such that it does not emit the chroma key color. In such embodiments, light control circuit 102 can control lighting device 104 to specifically light a subject. For example, sensor 114 can detect shadow areas or other lighting issues within the viewed portion of image capture device 112. Light control circuit 102 can then use the data received from sensor 114 via bus 110 to drive individual lights or light groups within lighting device 104 to address the lighting issue.

[0024] Lighting device 104 can include one or more lights that are controlled and driven by light control circuit 102. Each light in lighting device 104 can receive a control signal from light control circuit 102 and emits light based on the received control signal. In some instances, the control signal can alter the light over a set period and can change light characteristics like color and intensity and can control whether the light is on or off (e.g., "strobe effect").

[0025] In some embodiments, lighting device 104 can comprise an array of light-emitting diodes (i.e., an "LED array"). The LEDs, such as red-green-blue (RGB) or red-green-blue-white (RGB + W)-type LEDs, can be used in conjunction with other LEDs in a group to display multiple colors at a high resolution, depending on the resolution of LED array 104. In some embodiments, the LED array 104 can also include infrared LEDs. Light control circuit 102 can control the LED array 104 such that only those infrared LEDs within the viewed portion emit infrared light. In such instances, in lieu of the viewed portion emitting a chroma key color, image processing circuit 106 can use the detected infrared region to replace the background. When this occurs, the other RGB or RGB + W LEDs within the viewed portion can emit the ambient light.

[0026] In some embodiments, lighting device 104 can comprise a projector. In such embodiments, projector 104 can emit light onto one or more screens placed between projector 104 and image capture device 112. In such instances, light control device 102 can drive images that are projected through projector 104 onto one or more screens. In some embodiments, projector 104 emits a chroma key color within the viewed portion of image capture device 112. In some embodiments, projector 104 can include an infrared filter. In such instances, projector 104 can, in lieu of projecting a chroma key color, project infrared light only within the viewed portion of image capture device 112.

[0027] In some embodiments, lighting device 104 can comprise multiple groups of lights. For example, lighting device 104 can comprise six walls of lights surrounding a subject. Light control circuit 102 can control each of the six discrete walls separately. In some embodiments, light control circuit 102 can control smaller groups of lights or individual lights within a light group. For example, light control circuit 102 can control a group of lights on a "front wall" light group as a skeuomorphic front spotlight.

[0028] User interface (UI) 104 can include hardware and/or software that communicates between the user and light control circuit 102. In some embodiments, UI 104 can be a graphic user interface (GUI) that can display graphical representations of lighting device 104 and/or the frame being filmed by image capture device 112. In some embodiments, UI 106 and display 108 can be used by the user to generate and/or modify a controlled lighting sequence to be sent by light control circuit 102 to control light characteristics for one or more lights in lighting device 104. In some embodiments, the UI displays light groups within lighting device 104 as skeuomorphic lights within a light plot. A user can use UI 106 software to control such light groups like a single piece of lighting equipment. In some embodiments, UI 106 includes physical controls used to control one or more lights through light control circuit 102.

[0029] Display 108 can be a monitor that receives signals via bus from other devices in light control apparatus 100, such as image capture device 112, image processing circuit 116, UI 106, image storage device 118, and/or light control device 102, and displays an image based on the received signal. In some embodiments, light control apparatus 100 can include multiple displays 108, such as discrete displays for image capture device 112 and image processing device 116, respectively. Display 108 can be a liquid-crystal display (LCD) monitor or other digital display.

[0030] Bus 110 can be a line bus that facilitates communications between multiple devices in light control apparatus 100. In some embodiments, all devices controlled via bus 110 are in the same device. In some embodiments, devices in light control apparatus 100 can communicate wirelessly; in such instances, bus 110 can be replaced with a wireless communications apparatus.

[0031] Image capture device 112 can comprise, for example, a still camera or video camera that captures images or video lit by lighting device 104. In some embodiments, image capture device 112 can be within lighting device 104. For example, when lighting device 104 includes six walls of lights, image capture device can be within the six light walls with the subject.

[0032] In some embodiments, one or more sensors 114 can be included with image capture device 112 to determine the field of vision of image capture device 112. In such instances, sensor 114 in image capture device 112 can send a signal to light control circuit 102 that it then uses to set a viewed portion of lighting device 104. In some embodiments, image capture device 112 can send its characteristics (e.g., aperture, shutter speed, video frame rate, view angle, etc.) to light control circuit 102, which light control circuit 102 can use to generate or modify a controlled lighting sequence for lighting device 104.

[0033] Sensor 114 can be, for example, one or more internal sensors inside of image capture device 112 or light control circuit 102, or one or more external sensors positioned relative to image capture device 112 and lighting device 104. Sensor 114 can be, for example, a visible light sensor, infrared light sensor, and/or gyroscope that can be used to determine the field of vision of image capture device 102. In some embodiments, sensor 114 can be used to determine other quantitative measurements, such as light intensity, light temperature, room temperature, etc.

[0034] Measurements made by sensor 114 can be used by other devices in light control apparatus 100 to calibrate the controlled lighting sequence. In some embodiments, measurements made by sensor 114 can be used in maintenance and troubleshooting, such as when the light temperature is excessively high. In some embodiments, sensors 114 can be used to determine lighting issues within the visible portion of image capture device 112, such as detecting shadow areas on a subject. One or more sensors 114 can send the lighting data to light control circuit 102, which can change light characteristics of individual lights within lighting device 104 to change the detected shadow areas.

[0035] Image processing circuit 116 can include hardware to generate a composite image based on one or more images captured by image capture device 112. In some embodiments, image processing circuit 116 can generate a composite image based on an image received from image capture device 112 and an image retrieved from image storage device 118. In some embodiments, image processing circuit 116 can include software and/or a user interface (not shown) to enable a user to generate a composite image. In some embodiments, image processing circuit 116 generates the composite image in real time, receiving images from image capture device 112 as they are recorded. In some embodiments, image processing circuit 116 generates the composite image after all images were recording, retrieving both the images recorded by image capture device 112 using lighting device 104 and other images from image storage device 118.

[0036] In some embodiments, generation of a composite image is aided based on the lighting device 104. For example, image capture device 112 can record an image with a chroma key background (e.g., the viewed portion of lighting device 104) while the subject is lit with ambient light. Image processing circuit 116 can retrieve another image (in some instances, from image storage device 118) and can replace the chroma key color in the recorded image of image capture device 112 with the other, retrieved image to generate the composite image. In such instances, the subject in the composite image is lit with ambient light even though chroma keying was used to replace the background in the image.

[0037] In some embodiments, image processing circuit 116 can merge two images recorded by image capture device 112. For example, the controlled lighting sequence drives lighting device 104 such that it alternates between displaying a chroma key color for half of the recorded frames and displaying ambient light for the remaining half of recorded frames. Image processing circuit 116 can merge consecutive images together through a process like genlocking such that the composite image is lit with ambient light even though chroma keying was used to enable image processing circuit 116 to replace the background in the image.

[0038] Image storage device 118 can be one or more databases, hard drives, video recording devices, and/or other media storage devices that store information for other devices in light control apparatus 100. In some embodiments, image storage device 118 stores images and/or video that light control circuit 102 uses as a reference when generating a controlled lighting sequence, such that lighting device 104 emulates playback of the stored image or video. For example, a user can upload high-resolution photographs and/or video to image storage device 118. Light control circuit 102 can then use the stored images and/or videos to generate a controlled lighting program for playback through lighting device 104 as ambient light emulating the stored media.

[0039] In some embodiments, users can download reference images onto image storage device 118 based on entered global positioning system (GPS) coordinates. For example, a user can enter coordinates {36.115369, -115.172761} and {36.121852, -115.171816} to retrieve multiple images between the two coordinates representing "The Strip" in Las Vegas. Multiple images and/or video can be stored in image storage device 118. Light control circuit 102 can then retrieve the stored images and/or videos to generate a controlled lighting program for playback through lighting device 104 as ambient light emulating the stored media.

[0040] In some embodiments, image storage device 118 stores the images recorded by image capture device 112 and/or composite images generated by image processing circuit 116. In such instances, image storage device 118 can also store the original images used by image processing unit 116 to generate the composite images.

[0041] FIG. 2 illustrates an exemplary lighting device. Lighting device 200 includes light wall sections 201a-b, viewed light portion 203, and programmed light sections 205a, 205b. In some embodiments, lighting device 200 can also include other wall sections (not shown) to surround a subject when capturing and image or video. For example, lighting device can include back wall portion 201a, front wall portion 201b positioned next to image capture device 112, a ceiling portion (not shown) above wall portions 201a-b, a ground portion (not shown), and image capture device 112.

[0042] Viewed light portion 203 is the portion of lighting device 200 that is in the field of vision of image capture device 112. In some embodiments, sensor 114 can make measurements that image capture device 112 and/or light control circuit 102 use to determine viewed portion 203 within lighting device 200. In some embodiments, image capture device 112 and/or light control circuit 102 can determine changes in the field of vision of image capture device 112 and modify the lights included in viewed portion 203. In some embodiments, light control circuit 102 can specifically control viewed portion 203 relative to lighting device 200 such that all the lights in viewed portion 203 display a chroma key color, while all other lights in lighting device 200 display ambient light based on an ambient light profile included in the controlled light sequence.

[0043] Programmed light sections 205a, b can be sections of lights within lighting device 104 that are specifically controlled by light control circuit 102 as a group. For example, light section 205a can be controlled together as a skeuomorphic spotlight and light section 205a can be controlled together as a specific geometric shape. In some embodiments, light section 205a can be as small as a single light or LED.

[0044] Users can control light section 205a, b within lighting device 200 to employ greater lighting control beyond a programmed light sequence based on a reference background image by using light sections to generate incident light on objects within the frame. For example, a user can add a light plot to the controlled lighting sequence and can control light characteristics of each skeuomorphic light within the light plot. When using the light plot, a controlled light sequence can be programmed such that for lighting device 200, all lights that are not in viewed section 203 or light sections 205a-b are displaying a programmed sequence of ambient light, viewed section 203 is displaying a chroma key color, and light sections 205a-b are displaying white lights to emulate spotlights. Image capture device 112 can then capture an image that specifically lights a subject in accordance with artistic lighting conventions, while also lighting the subject and other objects with appropriate ambient light and having a chroma key background light for post-production editing to create a composite image.

[0045] FIG. 3 illustrates an exemplary image employing an embodiment of the light control apparatus. Composite image 300 can be generated, for example, by image processing circuit 116 based on a background image stored in image storage device 118 and a recorded image of subjects using lighting device 104 and image capture device 112. Composite image 300 includes a background image 301, subjects 303a, b and specific subject lighting 305a, b.

[0046] Background image 301 can be, for example, an image replaced by image processing circuit 116 during post-production to replace a chroma key color background 203 generated by lighting device 104, 200. In some embodiments, background image 301 can be a high-resolution image displayed by lighting device 104 during specific frames of a controlled lighting sequence driven by light control circuit 102. For example, projector 104, 200 can display a high-resolution image or video onto wall portion 201a, with the viewed portion 203 being captured as background image 301.

[0047] Subjects 303a, b can be between light wall 201a and image capture device 112 during recording and can be subject to reflections of light made by all lights in lighting device 200. In some instances, subjects 303a, b can reflect light based on the display of lights in lighting device 200.

[0048] The subject reflection 305a, b can be reflections of ambient light displayed by lighting device 104, such as non-viewed portions of lighting device 104 and skeuomorphic spotlights 205a, b. In some embodiments, subject reflections 305 a, b can be initial shadow areas detected by sensor 114. Light control circuit 102 can generate an incident lighting profile within the controlled lighting sequence that controls one or more lights in lighting device 104 to address the detected shadow region. In some embodiments, subject reflections 305a, b are captured in one frame, while a chroma-keyed image is captured in another frame. Image processing circuit 116 can merge the two frames to produce a composite image 300 that replaces the chroma key background with background 301 while maintaining the subject reflections 305a, b from the ambient light frame.

[0049] FIG. 4 illustrates a flowchart for lighting a scene using an embodiment of the light control apparatus. Light control apparatus 100 or light control circuit 102 can employ method 400 to generate a controlled light sequence and control lighting device 104, 200 when recording an image or video for later post-production editing. Method 400 can start at step 401 and proceed to step 403, where light control circuit 102 can determine lighting regions in lighting device 104, 200. In some embodiments, the lighting regions include viewed portion 203 and/or light sections 205a, b that comprise a light plot within lighting device 104, 200. In some embodiments, specific lighting regions may change over the period of the controlled lighting sequence, such as when image capture device 112 moves during recording period. In such instances, light control circuit 102 determines the specific lights included within each lighting region over each step (i.e., "route") and set the lighting regions for each frame to be filmed over the set period.

[0050] Once the lighting regions for lighting device 104, 200 are set, light control circuit 102 can then proceed to step 405, where it generates a controlled lighting sequence. In some embodiments, light control circuit 102 can receive instructions from the user via UI 106 when producing the controlled lighting sequence. The controlled lighting sequence can include, for example, light characteristics for ambient light (i.e., "ambient light profile"), chroma key lighting settings, light sections for a light plot, skeuomorphic light settings, and other lighting characteristic settings for each light over every frame in the set period.

[0051] After generating the controlled lighting sequence, light control circuit in step 102 can proceed to step 407, where it determines whether to load images or video from DB 118. In some embodiments, light control circuit 102 can generate or modify the ambient light profile to represent a route generated from reference images or photographs, such as images saved in DB 118 or a set or sequence of GPS coordinates with associated landscape images stored by a third-party. If light control device 102 determines to load an image from DB 118 or from GPS coordinates, it proceeds to step 411, where it retrieves an image from DB 118. In some embodiments, light control device 102 retrieves images from a third-party database, such as a database of images based on GPS coordinates.

[0052] After retrieving the image, light control circuit in step 413 can drive the lighting device 104, 200 to generate ambient light based on the loaded image. Light control circuit can, for example, control lighting device 104, 200 to display ambient light in the unviewed portions of lighting device 104, 200. In some embodiments, the loaded image modifies the controlled lighting sequence generated in step 405.

[0053] If, in step 407, light control circuit 102 determines not to load an image from a database, it proceeds to step 421, where it drives lighting device 104, 200 to generates ambient light. In instances where light control circuit 102 does not generate ambient light based on a stored image, light control circuit 102 can generate ambient light, for example, based on the controlled lighting sequence generated in step 405.

[0054] After either step 413 or 421, light control circuit can proceed to step 431, where it drives lighting device 104, 200 to generate a chroma key light. In some embodiments, the chroma key light generated is only for viewed portion 203 of lighting device 104, 200. In some embodiments, light control circuit 201 drives lighting device 104, 200 to alternate between displaying the ambient light generated in step 413 and the chroma key light generated in step 431. Once the chroma key light is generated, light control circuit 102 can proceed to step 433 to end method 400.

[0055] It should be apparent from the foregoing description that various exemplary embodiments of the invention may be implemented in hardware and/or firmware. Furthermore, various exemplary embodiments may be implemented as instructions stored on a machine-readable storage medium, which may be read and executed by at least one processor to perform the operations described in detail herein. A machine-readable storage medium may include any mechanism for storing information in a form readable by a machine, such as a personal or laptop computer, a server, or other computing device. Thus, a machine-readable storage medium may include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, and similar storage media.

[0056] It should be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative circuitry embodying the principals of the invention. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudo code, and the like represent various processes which may be substantially represented in machine readable media and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.

[0057] Although the various exemplary embodiments have been described in detail with particular reference to certain exemplary aspects thereof, it should be understood that the invention is capable of other embodiments and its details are capable of modifications in various obvious respects. As is readily apparent to those skilled in the art, variations and modifications can be affected while remaining within the scope of the invention. Accordingly, the foregoing disclosure, description, and figures are for illustrative purposes only and do not in any way limit the invention, which is defined only by the claims.

Claims

1. A video and lighting control apparatus (100) comprising:

a video display (104) including a plurality of multi-color lighting devices, including a viewed portion that displays light based on a viewed portion source, and an unviewed portion that displays ambient light based on at least one video or image; and

a video control circuit (102) that controls the viewed and unviewed portions based on a controlled lighting sequence comprising an ambient light profile, wherein the unviewed portion emits light according to the ambient light profile to create ambient light in a scene that emulates the at least one video or image; and

a video capture device (112) that records a first image of the scene, wherein the viewed portion of the display is in a field of vision of the video capture device and the unviewed portion is not in the field of vision of the video capture device.

2. The apparatus of claim 1, wherein at least the viewed portion of the display emits infrared light.

3. The apparatus of claim 2, wherein the video display is configured to automatedly alternate between emitting infrared light and displaying the ambient light profile.

4. The apparatus of claim 3, wherein the video capture device is configured to capture a number of frames per second, wherein the viewed portion is configured to automatedly alternate between emitting infrared light for one or more frames and displaying the ambient light profile for one or more frames such that for any number of sequential frames captured by the video capture device in a single recording session, at least one of the captured frames does not include infrared light and at least one of the captured frames does include infrared light.

5. The apparatus of claim 4, wherein the control circuit is configured to use genlocking to synchronize the video capture device, the viewed portion, and the unviewed portion.

6. The apparatus of claim 1, wherein the controlled lighting sequence further comprises:

a chroma key color profile; and

an incident light profile.

7. The apparatus of claim 6, further comprising:
at least one light sensor (114) for recording light measurements, wherein the control circuit determines the field of vision of the video capture device based on light measurements, and wherein the control circuit generates the incident light profile based on the light measurements.

8. The apparatus of claim 1, further comprising:
a sensor (114) that records light measurements, wherein the control circuit is configured to determine the field of vision of the video capture device based on the light measurements and to set the viewed portion of the display to correspond with only the multi-color lighting devices that are in the determined field of vision of the video capture device.

9. The apparatus of claim 8, wherein the control circuit is configured to cause the viewed portion of the display to display a chroma key color and to cause the unviewed portion of the display to display ambient light.

10. The apparatus of claim 1, wherein at least the viewed portion of the display displays a chroma key color and the display is configured to automatedly alternate between displaying the chroma key color and the ambient light profile.

11. The apparatus of claim 10, wherein the video capture device is configured to capture a number of frames per second, wherein the display is configured to automatedly alternate between displaying the chroma key color for one or more frames and the ambient light profile for one or more frames such that for a first plurality of sequential frames captured by the video capture device in a single recording session, at least one of the captured frames does not include the chroma key color and at least one of the captured frames does include the chroma key color.

12. The apparatus of claim 1, wherein the control circuit is configured to use genlocking to synchronize the video capture device, the viewed portion, and the unviewed portion.

13. The apparatus of claim 1, further comprising an image storage device that includes a plurality of reference images stored in association with corresponding global positioning system coordinates, wherein the control circuit is configured to retrieve reference images or video associated with particular global positioning system coordinates in order to generate the controlled lighting sequence.

14. The apparatus of claim 13, wherein the control circuit is configured to generate the controlled lighting sequence as a function of two sets of global positioning system coordinates and reference images or video associated with a route including the two sets of global positioning system coordinates.

15. The apparatus of claim 1, further comprising:
a sensor (114) operably connected to the video capture device for sensing a position of the video capture device, wherein the control circuit is configured to determine the field of vision of the video capture device based on readings from the sensor (114) and to set the viewed portion of the display to correspond with only the multi-color lighting devices that are in the determined field of vision of the video capture device.

16. The apparatus of claim 1, further comprising:
a sensor (114) that records light measurements, wherein the control circuit is configured to detect shadow areas within the field of vision of the video capture device and to change light characteristics of the display to change the detected shadow areas.

17. The apparatus of claim 1, wherein the control circuit is configured to determine the field of vision of the video capture device and set the viewed portion of the display to correspond with only the multi-color lighting devices that are in the determined field of vision of the video capture device.

18. The apparatus of any of claims 8, 15, or 17, wherein the control circuit is configured to adjust the viewed portion in response to a change in the determined field of vision while the video capture device is recording a video of the scene.

Ansprüche

1. Video- und Beleuchtungssteuerungseinrichtung (100), die Folgendes umfasst:

eine Videoanzeigevorrichtung (104), die mehrere Mehrfarbenbeleuchtungsvorrichtungen beinhaltet, aufweisend einen Sichtanteil, der Licht auf der Grundlage einer Sichtanteilquelle anzeigt, und einen Unsichtanteil, der Umgebungslicht auf der Grundlage von mindestens einem Video oder einem Bild anzeigt; und

eine Videosteuerungsschaltung (102), die den Sicht- und den Unsichtanteil auf der Grundlage einer gesteuerten Beleuchtungssequenz steuert, die ein Umgebungslichtprofil umfasst, wobei der Unsichtanteil Licht gemäß dem Umgebungslichtprofil emittiert, um in einer Szene, die das mindestens eine Video oder das eine Bild emuliert, zu schaffen; und

eine Videoaufnahmevorrichtung (112), die ein erstes Bild der Szene aufzeichnet, wobei sich der Sichtanteil der Anzeigevorrichtung in einem Sichtfeld der Videoaufnahmevorrichtung befindet und sich der Unsichtanteil nicht in dem Sichtfeld der Videoaufnahmevorrichtung befindet.

2. Einrichtung nach Anspruch 1, wobei zumindest der Sichtanteil der Anzeigevorrichtung Infrarotlicht emittiert.

3. Einrichtung nach Anspruch 2, wobei die Videoanzeigevorrichtung ausgelegt ist zum automatischen Abwechseln zwischen Emittieren von Infrarotlicht und Anzeigen des Umgebungslichtprofils.

4. Einrichtung nach Anspruch 3, wobei die Videoaufnahmevorrichtung ausgelegt ist zum Aufnehmen einer Anzahl von Frames pro Sekunde, wobei der Sichtanteil ausgelegt ist zum automatischen Abwechseln zwischen Emittieren von Infrarotlicht für einen oder mehrere Frames und Anzeigen des Umgebungslichtprofils für einen oder mehrere Frames, so dass für eine beliebige Anzahl von aufeinanderfolgenden Frames, die durch die Videoaufnahmevorrichtung in einer einzigen Aufzeichnungssitzung aufgenommen wurden, mindestens einer der aufgenommenen Frames kein Infrarotlicht enthält und mindestens einer der aufgenommenen Frames Infrarotlicht enthält.

5. Einrichtung nach Anspruch 4, wobei die Steuerungsschaltung ausgelegt ist zum Verwenden von Genlocking zum Synchronisieren der Videoaufnahmevorrichtung, des Sichtanteils und des Unsichtanteils.

6. Einrichtung nach Anspruch 1, wobei die gesteuerte Beleuchtungssequenz ferner Folgendes umfasst:

ein Chroma-Key-Farbprofil; und

ein Einfallslichtprofil.

7. Einrichtung nach Anspruch 6, ferner Folgendes umfassend:
mindestens einen Lichtsensor (114) zum Aufzeichnen von Lichtmessungen, wobei die Steuerungsschaltung das Sichtfeld der Videoaufnahmevorrichtung auf der Grundlage von Lichtmessungen bestimmt und wobei die Steuerungsschaltung das Einfallslichtprofil auf der Grundlage der Lichtmessungen erzeugt.

8. Einrichtung nach Anspruch 1, ferner Folgendes umfassend:
einen Sensor (114), der Lichtmessungen aufzeichnet, wobei die Steuerungsschaltung ausgelegt ist zum Bestimmen des Sichtfelds der Videoaufnahmevorrichtung auf der Grundlage der Lichtmessungen und zum Einstellen des Sichtanteils der Anzeigevorrichtung, um nur den Mehrfarbenbeleuchtungsvorrichtungen zu entsprechen, die sich in dem bestimmten Sichtfeld der Videoaufnahmevorrichtung befinden.

9. Einrichtung nach Anspruch 8, wobei die Steuerungsschaltung ausgelegt ist zum Veranlassen, dass der Sichtanteil der Anzeigevorrichtung eine Chroma-Key-Farbe anzeigt, und zum Veranlassen, dass der Unsichtanteil der Anzeigevorrichtung Umgebungslicht anzeigt.

10. Einrichtung nach Anspruch 1, wobei zumindest der Sichtanteil der Anzeigevorrichtung eine Chroma-Key-Farbe anzeigt und die Anzeigevorrichtung ausgelegt ist zum automatischen Abwechseln zwischen Anzeigen der Chroma-Key-Farbe und dem Umgebungslichtprofil.

11. Einrichtung nach Anspruch 10, wobei die Videoaufnahmevorrichtung ausgelegt ist zum Aufnehmen einer Anzahl von Frames pro Sekunde, wobei die Anzeigevorrichtung ausgelegt ist zum automatischen Abwechseln zwischen Anzeigen der Chroma-Key-Farbe für einen oder mehrere Frames und des Umgebungslichtprofils für einen oder mehrere Frames, so dass für erste mehrere von aufeinanderfolgenden Frames, die durch die Videoaufnahmevorrichtung in einer einzigen Aufzeichnungssitzung aufgenommen wurden, mindestens einer der aufgenommenen Frames die Chroma-Key-Farbe nicht enthält und mindestens einer der aufgenommenen Frames die Chroma-Key-Farbe enthält.

12. Einrichtung nach Anspruch 1, wobei die Steuerungsschaltung ausgelegt ist zum Verwenden von Genlocking zum Synchronisieren der Videoaufnahmevorrichtung, des Sichtanteils und des Unsichtanteils.

13. Einrichtung nach Anspruch 1, die ferner eine Bildspeicherungsvorrichtung umfasst, die mehrere mit entsprechenden Koordinaten des Global-Positioning-Systems verknüpfte gespeicherte Referenzbilder beinhaltet, wobei die Steuerungsschaltung ausgelegt ist zum Abrufen von Referenzbildern oder eines Referenzvideos, die/das mit bestimmten Koordinaten des Global-Positioning-Systems verknüpft sind, um die gesteuerte Beleuchtungssequenz zu erzeugen.

14. Einrichtung nach Anspruch 13, wobei die Steuerungsschaltung ausgelegt ist zum Erzeugen der gesteuerten Beleuchtungssequenz als eine Funktion von zwei Sätzen von Koordinaten des Global-Positioning-Systems und von Referenzbildern oder eines Referenzvideos, die/das mit einer Route verknüpft sind bzw. ist, die die zwei Sätze von Koordinaten des Global-Positioning-Systems beinhalten.

15. Einrichtung nach Anspruch 1, die ferner Folgendes umfasst:
einen Sensor (114), der mit der Videoaufnahmevorrichtung zum Erfassen einer Position der Videoaufnahmevorrichtung betreibbar verbunden ist, wobei die Steuerungsschaltung ausgelegt ist zum Bestimmen des Sichtfelds der Videoaufnahmevorrichtung auf der Grundlage von Auslesungen von dem Sensor (114) und zum Einstellen des Sichtanteils der Anzeigevorrichtung, um nur den Mehrfarbenbeleuchtungsvorrichtungen, die sich in dem bestimmten Sichtfeld der Videoaufnahmevorrichtung befinden, zu entsprechen.

16. Einrichtung nach Anspruch 1, die ferner Folgendes umfasst:
einen Sensor (114), der Lichtmessungen aufzeichnet, wobei die Steuerungsschaltung ausgelegt ist zum Detektieren von Schattengebieten innerhalb des Sichtfelds der Videoaufnahmevorrichtung und zum Ändern von Lichtcharakteristika der Anzeigevorrichtung, um die detektierten Schattengebiete zu ändern.

17. Einrichtung nach Anspruch 1, wobei die Steuerungsschaltung ausgelegt ist zum Bestimmen des Sichtfelds der Videoaufnahmevorrichtung und zum Einstellen des Sichtanteils der Anzeigevorrichtung, um nur den Mehrfarbenbeleuchtungsvorrichtungen, die sich in dem bestimmten Sichtfeld der Videoaufnahmevorrichtung befinden, zu entsprechen.

18. Einrichtung nach Anspruch 8, 15 oder 17, wobei die Steuerungsschaltung ausgelegt ist zum Anpassen des Sichtanteils als Reaktion auf eine Änderung in dem bestimmten Sichtfeld, während die Videoaufnahmevorrichtung ein Video der Szene aufzeichnet.

Revendications

1. Appareil de commande vidéo et d'éclairage (100) comprenant :

un affichage vidéo (104) comprenant une pluralité de dispositifs d'éclairage multicolore, comprenant une partie visualisée qui affiche la lumière sur la base d'une source de partie visualisée, et une partie non visualisée qui affiche la lumière ambiante sur la base d'au moins une vidéo ou image ; et

un circuit de commande vidéo (102) qui commande les parties visualisée et non visualisée sur la base d'une séquence d'éclairage commandée comprenant un profil de lumière ambiante, la partie non visualisée émettant de la lumière selon le profil de lumière ambiante pour créer une lumière ambiante dans une scène qui émule l'au moins une vidéo ou image ; et

un dispositif de capture vidéo (112) qui enregistre une première image de la scène, la partie visualisée de l'affichage étant dans un champ de vision du dispositif de capture vidéo et la partie non visualisée n'étant pas dans le champ de vision du dispositif de capture vidéo.

2. Appareil selon la revendication 1, au moins la partie visualisée de l'affichage émettant une lumière infrarouge.

3. Appareil selon la revendication 2, l'affichage vidéo étant configuré pour alterner automatiquement entre l'émission de lumière infrarouge et l'affichage du profil de lumière ambiante.

4. Appareil selon la revendication 3, le dispositif de capture vidéo étant configuré pour capturer un nombre de trames par seconde, la partie visualisée étant configurée pour alterner automatiquement entre l'émission de lumière infrarouge pour une ou plusieurs trames et l'affichage du profil de lumière ambiante pour une ou plusieurs trames de telle sorte que pour un nombre quelconque de trames séquentielles capturées par le dispositif de capture vidéo dans une session d'enregistrement unique, au moins une des trames capturées ne comprend pas de lumière infrarouge et au moins une des trames capturées comprend de la lumière infrarouge.

5. Appareil selon la revendication 4, le circuit de commande étant configuré pour utiliser un asservissement pour synchroniser le dispositif de capture vidéo, la partie visualisée et la partie non visualisée.

6. Appareil selon la revendication 1, la séquence d'éclairage commandée comprenant en outre :

un profil de couleur d'incrustation ; et

un profil de lumière incidente.

7. Appareil selon la revendication 6, comprenant en outre :
au moins un capteur de lumière (114) pour enregistrer des mesures de lumière, le circuit de commande déterminant le champ de vision du dispositif de capture vidéo sur la base des mesures de lumière, et le circuit de commande générant le profil de lumière incidente sur la base des mesures de lumière.

8. Appareil selon la revendication 1, comprenant en outre :
un capteur (114) qui enregistre des mesures de lumière, le circuit de commande étant configuré pour déterminer le champ de vision du dispositif de capture vidéo sur la base des mesures de lumière et pour régler la partie visualisée de l'affichage pour qu'elle corresponde uniquement aux dispositifs d'éclairage multicolore qui sont dans le champ de vision déterminé du dispositif de capture vidéo.

9. Appareil selon la revendication 8, le circuit de commande étant configuré pour faire en sorte que la partie visualisée de l'affichage affiche une couleur d'incrustation et pour faire en sorte que la partie non visualisée de l'affichage affiche la lumière ambiante.

10. Appareil selon la revendication 1, au moins la partie visualisée de l'affichage affichant une couleur d'incrustation et l'affichage étant configuré pour alterner automatiquement entre l'affichage de la couleur d'incrustation et le profil de lumière ambiante.

11. Appareil selon la revendication 10, le dispositif de capture vidéo étant configuré pour capturer un nombre de trames par seconde, l'affichage étant configuré pour alterner automatiquement entre l'affichage de la couleur d'incrustation pour une ou plusieurs trames et le profil de lumière ambiante pour une ou plusieurs trames de telle sorte que pour une première pluralité de trames séquentielles capturées par le dispositif de capture vidéo dans une session d'enregistrement unique, au moins une des trames capturées ne comprend pas la couleur d'incrustation et au moins une des trames capturées comprend la couleur d'incrustation.

12. Appareil selon la revendication 1, le circuit de commande étant configuré pour utiliser un asservissement pour synchroniser le dispositif de capture vidéo, la partie visualisée et la partie non visualisée.

13. Appareil selon la revendication 1, comprenant en outre un dispositif de stockage d'images qui comprend une pluralité d'images de référence stockées en association avec des coordonnées de système de positionnement global correspondantes, le circuit de commande étant configuré pour récupérer des images de référence ou une vidéo associées à des coordonnées de système de positionnement global particulières afin de générer la séquence d'éclairage contrôlée.

14. Appareil selon la revendication 13, le circuit de commande étant configuré pour générer la séquence d'éclairage commandée en fonction de deux jeux de coordonnées de système de positionnement global et d'images de référence ou de vidéo associées à un itinéraire comprenant les deux jeux de coordonnées de système de positionnement global.

15. Appareil selon la revendication 1, comprenant en outre :
un capteur (114) connecté de manière opérationnelle au dispositif de capture vidéo pour détecter une position du dispositif de capture vidéo, le circuit de commande étant configuré pour déterminer le champ de vision du dispositif de capture vidéo sur la base de lectures provenant du capteur (114) et pour régler la partie visualisée de l'affichage pour qu'elle corresponde uniquement aux dispositifs d'éclairage multicolore qui sont dans le champ de vision déterminé du dispositif de capture vidéo.

16. Appareil selon la revendication 1, comprenant en outre :
un capteur (114) qui enregistre des mesures de lumière, le circuit de commande étant configuré pour détecter des zones d'ombre dans le champ de vision du dispositif de capture vidéo et pour changer les caractéristiques de lumière de l'affichage afin de changer les zones d'ombre détectées.

17. Appareil selon la revendication 1, le circuit de commande étant configuré pour déterminer le champ de vision du dispositif de capture vidéo et pour régler la partie visualisée de l'affichage pour qu'elle corresponde uniquement aux dispositifs d'éclairage multicolore qui sont dans le champ de vision déterminé du dispositif de capture vidéo.

18. Appareil selon l'une quelconque des revendications 8, 15 et 17, le circuit de commande étant configuré pour ajuster la partie visualisée en réponse à un changement du champ de vision déterminé pendant que le dispositif de capture vidéo enregistre une vidéo de la scène.

Drawing