(19)
(11)EP 3 448 346 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
04.11.2020 Bulletin 2020/45

(21)Application number: 17737063.2

(22)Date of filing:  27.04.2017
(51)International Patent Classification (IPC): 
A61H 5/00(2006.01)
G02B 25/00(2006.01)
(86)International application number:
PCT/IT2017/000089
(87)International publication number:
WO 2017/187468 (02.11.2017 Gazette  2017/44)

(54)

METHOD FOR MODIFYING AT LEAST ONE FRAME VIDEO OF A DIGITAL VIDEO STREAM TO BE DISPLAYED ON A DISPLAYING AREA AND RELATED SYSTEM

VERFAHREN ZUR MODIFIZIERUNG VON MINDESTENS EINEM VIDEOEINZELBILD EINES AUF EINEM ANZEIGEBEREICH ANZUZEIGENDEN DIGITALVIDEO-STREAMS UND ZUGEHÖRIGES SYSTEM

PROCÉDÉ DE MODIFICATION D'AU MOINS UNE TRAME VIDÉO D'UN FLUX VIDÉO NUMÉRIQUE À AFFICHER SUR UNE ZONE D'AFFICHAGE ET SYSTÈME ASSOCIÉ


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 27.04.2016 IT UA20162920

(43)Date of publication of application:
06.03.2019 Bulletin 2019/10

(73)Proprietor: Consiglio Nazionale Delle Ricerche
00185 Roma (IT)

(72)Inventors:
  • LODATO Carmelo
    00185 Roma (RM) (IT)
  • RIBINO, Patrizia
    00185 Roma (RM) (IT)

(74)Representative: Santi, Filippo et al
Barzanò & Zanardo Roma S.p.A. Via Piemonte 26
00187 Roma
00187 Roma (IT)


(56)References cited: : 
US-A1- 2013 057 644
US-A1- 2015 257 967
  
      
    Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


    Description


    [0001] The present invention relates to a method and a relative system for modifying at least one video frame of a digital video stream to be displayed on a display area.

    [0002] In particular, using this method, one or more digital video frames of said video stream are modified and coded to be displayed on a display area of a stereoscopic or autostereoscopic video system so that the contents of such video frames is perceived, by a person suffering from a degenerative disease of the retina (watching that display area), as correct or less affected by defects.

    [0003] Using that method, the perception of visual defects, that a person suffering from said retinal degenerative disease may have in watching an image on a display surface, can be prevented and/or mitigated by changing that image and, therefore, the binocular vision of a person suffering from such a retinal degenerative disease is improved.

    [0004] What we see is the visual perception of what we observe, that is, a resulting mental representation of the brain's elaboration, precisely in the visual cortex, of the signals coming from the eyes. These signals derive from the conversion of light stimuli into electrical impulses. This conversion is made by light-sensitive nerve cells (cone and rod cells) that form a retina layer. In other words, the eyes act as sensors wherein cone and rod cells work as photoreceptors.

    [0005] An eye disease that somehow compromises its functioning can cause generation and transmission of altered signals to the brain.

    [0006] In some particular cases, the merging process of the signals coming from the two eyes, effected by the cerebral cortex, can detect any anomalies and compensate for a proper binocular visual perception. When this is not possible, eye disease causes an incorrect visual perception.

    [0007] In the latter case, therapeutic or non-therapeutic remedies can be made.

    [0008] A therapeutic approach relates to procedures that act on the cause of the visual disorder.

    [0009] For example, a drug or surgery may eliminate the defect in the eye. By using this medication or surgical procedure, it is possible to treat and heal the subject affected by the disease.

    [0010] A non-therapeutic approach may include visual aids that, limited to the period of their use, can attenuate or eliminate completely the perception of visual defects without, however, intervening on the physiological causes of such visual defects.

    [0011] This type of approach does not act on the person (i.e. on the organic causes) but on what the person sees.

    [0012] In this context, the method (and the related system) subject-matter of the invention is introduced, since one or more video frames of a digital video stream referring to any visual content of interest (such as an image, in particular a photograph, or a television broadcast or a live video or a recorded video or a video output of a computer) displayed on a display area are modified to compensate for visual defects perceived by a subject suffering from a degenerative retinal disease, so that the visual perception of the subject is improved.

    [0013] In other words, the method acts on one or more video frames reproduced on a display area and observed by said subject suffering from a degenerative retinal disease.

    [0014] Consequently, the method of the invention has no influence on the retinal degenerative pathology and does not in any way alter the state of health of the subject in relation to said degenerative retinal disease and is therefore not a therapeutic method.

    [0015] The subject remains affected by a degenerative retinal disease and the severity of such retinal degenerative pathology does not change with the application of the method.

    [0016] The retinal degenerative pathologies are widespread and constantly increasing, especially for people over 50 years of age.

    [0017] The retinal degenerative pathologies can cause serious and disabling visual defects for a person.

    [0018] In general, degenerative retinal disorders cause degeneration of one or more areas of the retina and in particular of the macula, i.e. the retinal area responsible for the central vision and the ability to distinguish the details.

    [0019] By simplifyingly, it is possible to imagine the retina as a membrane, disposed within a spherical shell, on which a plurality of cells is predisposed to the photoreceptor function.

    [0020] The degeneration of the retina can result in an alteration in the shape of the membrane and hence an alteration in the disposition and orientation of the above cells. As a result, the image that is reconstructed by the brain, based on signals received from said cells, may be perceived distorted in the membrane areas in which the latter has assumed a curvature different from the normal one.

    [0021] The effects may be different and more or less serious.

    [0022] For example, if a focus is kept on a grid at the junction between a vertical line and a horizontal line (the so-called Amsler test), a healthy person sees rightly this point and also correctly perceives the rest of that grid, arranged around that point, included in its own field of view.

    [0023] Unlike a healthy person, a person suffering from a degenerative retinal disease may have several visual defects. For example, he/she can see at least one portion of image as distorted (more or less accentuated) or he/she can see at least one image portion as blurred.

    [0024] If the retinal degeneration is particularly severe, the perceived image may even be deprived of one or more portions (loss of partial visual information).

    [0025] If the retinal degeneration affects only one eye, the most immediate possibility for carrying out most of the activity is the occlusion of that eye.

    [0026] It is clear that this may be useless when both eyes are affected by a degenerative retinal disease. Some remedies for degenerative diseases are based on a surgical procedure.

    [0027] For example, in some cases, it is possible to intervene with a laser to block the growth of abnormal blood vessels which cause swelling and consequently a deformation of the retina.

    [0028] However, surgery may be risky, considering that patients are often elderly.

    [0029] In other cases, where retinal degeneration can be caused by filamentous structures that act so as to raise and deform the retina layers, medication can be used, for example by injecting an enzyme that digests these filaments.

    [0030] The remedies mentioned above are invasive remedies (especially those based on a surgery) and generally have a reduced success rate. In addition, remedies are more destined to blocking the progression of the disease rather than restoring a proper binocular vision.

    [0031] In less severe cases, it is possible to reduce the perception of visual defects or improve binocular vision by using optical technologies. For example, through prismatic lenses, one can move an image of the scene that is observed in areas of the retina that are healthy, i.e. without any degenerative pathology.

    [0032] The principle used is based on the brain's ability to correct or compensate, within certain limits, a misalignment between the images that come from the two eyes.

    [0033] Additionally, to improve binocular vision, you can use different devices configured to enlarge an image, such as magnifiers or projectors. Such devices help improve binocular vision and are useful for a person for some daily activities, such as reading.

    [0034] A known method for correcting macular distortion is described in US Pat. No. 8,708,495.

    [0035] The patent refers to a computerized system that allows a patient to visualize and modify the Amsler grid by moving the nodes of said Amsler grid according to his/her perception of the image.

    [0036] The system calculates the vector field of displacements with a predetermined resolution by means of a two-dimensional interpolation scheme based on the displacements of said nodes. At this point, the images, that it receives as input, can be edited before being displayed, by applying predetermined shifts to them so to deform such images in such a way that the patient perceives them as correct.

    [0037] A disadvantage of this system is that a patient may be disturbed by a part of the frame of the Amsler grid test, although that part doesn't fall into a retinal area subjected to deformation.

    [0038] A further disadvantage is that the area of the deformation retina is identified with a fixed resolution.

    [0039] US 2015/257967 A1 describes a device for recognising and responding to Strabismus and Autism as well as a method for eye-tracking and software analysis used to identify adverse visual characteristics of both in real time and compelling visual feedback to stimulate correction as those events occur, the method for identifying and responsively discouraging strabismic behavior comprising: playing a video for viewer; measuring the distance from the viewer's eyes to the intersection of their vision axes; calculating the difference between that measured distance and the actual distance between the viewer's eyes and the display; degrading the visibility of the displayed image if the magnitude of said difference exceeded a reasonable threshold value and making the degradation of that image essentially proportional to the magnitude of that difference; improving the visibility of the displayed image if the magnitude of said difference is below said reasonable threshold value and making the improvement of that image essentially proportional to improvements in that difference where that is possible; continue above with measuring the distance from the viewer's eyes to the intersection of a vision axes.

    [0040] US 2013/057644 A1 shows in the field of 3D technology a computerimplemented method and a system to perform an operation that includes receiving a multiscopic video frame including at least a first and a second image, analysing the images and determining a set of image characteristics. Based on the set of those characteristics a mapping function is generated. A third image based on the mapping function is also created. A method and a known device for improving vision in subjects with a retinal disease are described in US patent application 2014/0210970.

    [0041] In this patent application, one refers to a disease of the retina that can impair central vision and have glasses or headsets for virtual reality or augmented reality.

    [0042] The method consists in the possibility to correct a defect degeneration by moving a portion of the image in the healthy parts of the retina, essentially arranged around the perimeter of the retina itself.

    [0043] However, even this method of known type has disadvantages.

    [0044] A disadvantage is the fact that the method is based on the brain's ability to correct or compensate for misalignment between the two images that are received from their eyes.

    [0045] However, the brain cannot compensate for any misalignment, therefore there is a risk that a person sees a double image or that the image itself is subject to dynamic effects, such as flicker.

    [0046] Another disadvantage is that the image processing requires considerable memory and remarkable execution speed to prevent the scene observed by a person loses fluidity, due to the dynamic range of the scene itself. As a result, fast movements within a scene or fast passages from one scene to the next scene may be lost.

    [0047] Consequently, it is necessary to create a specific hardware to mount on spectacles or headsets, with the costs incurred to make the hardware and glasses or headsets.

    [0048] The object of the present invention is to overcome those disadvantages by providing a method for modifying one or more video frames of a digital video stream and rendering it compatible with a stereoscopic or autostereoscopic video system so that it is displayed on a display area of said stereoscopic or autostereoscopic system, thus eliminating and/or reducing the perception of visual defects in a subject suffering from a degenerative retinal disease when said subject looks at said digital video stream on said display area.

    [0049] Advantageously, the binocular vision of that subject while watching digital video flow is improved.

    [0050] In particular, on the one hand, it is possible to eliminate the perception of visual defects caused by one or more alterations at one or more areas of the retina of an eye or both eyes when the degenerative retinal disease does not cause a loss of visual information.

    [0051] On the other hand, it is possible to reduce the perception of such visual defects, when such alterations cause a loss of visual information.

    [0052] This was achieved by a non-therapeutic method that allows two digital video streams, distinct from each other, to be generated from a digital video stream related to any visual content (such as a photograph, television broadcast, or live video), wherein each of said two digital video streams is intended for a respective eye and allows for correction schemes to be applied to at least one of said two digital video streams to modify the respective digital video stream so that the person suffering from degenerative pathology of the retina may have an improved visual perception or correct binocular vision.

    [0053] It is therefore an object of the invention to modify one or more video frames of a digital video stream to be displayed on a display area, wherein
    • a first eye reference system or right eye reference system is associated with the right eye, said right eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of the right eye, having an origin in the center of the cornea of said right eye and comprising a first axis, a second axis and a third axis, wherein said second axis is orthogonal to an interpupillary axis, wherein said interpupillary axis is a straight line passing through the center of the right eye cornea and the center of the left eye cornea, and said third axis coincides with a first visual axis, wherein said first visual axis is a straight line for the center of the right eye cornea and through an eye fixation point wherein said eye fixation point is a point of said display area observed by a person, said display area being part of a stereoscopic or autostereoscopic video system,
    • a second eye reference system or left eye reference system is associated with the left eye, said left eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said left eye, having an origin in the center of the cornea of said left eye and comprising a first axis, a second axis and a third axis, wherein said second axis is orthogonal to said interpupillary axis and said third axis coincides with a second visual axis, said second visual axis being a line passing through the center of the cornea of said left eye and through said eye fixation point,
    • a display reference system is bound to the display area, said display reference system being a three-dimensional Cartesian coordinate system, having an origin in the center of the display area and comprising a first axis, a second axis, and a third axis, wherein said first axis is horizontal and said third axis is perpendicular to a display plane, wherein said display plane is a plane passing through said display area and arranged so that the display area belongs to the display plane.


    [0054] In particular, said method comprises the following steps:

    A) acquiring a first digital video stream, where said first digital video stream comprises a succession of first video frames;

    B) individuating with respect to said first digital video stream,
    for the right eye, the shape, size and position of at least one first portion of video frame of at least one first video frame for which at least one first visual defect is perceived by said person, wherein the shape, size and position of said at least one first portion of a video frame is determined when said right eye reference system has the origin in a predetermined first position and a predetermined first orientation so that the following predetermined first conditions are satisfied:

    said eye fixation point coincides with the center of said display area,

    said right eye is at a predetermined first distance from said display area, and

    said first axis and said second axis of said right eye reference system are parallel respectively to said first axis and said second axis of said display reference system;

    and/or

    for the left eye, the shape, size and position of at least one second portion of video frame of at least one first video frame at which at least one second visual defect is perceived by said person, wherein the shape, size and position of said at least one second portion of video frame are determined when said left eye reference system has the origin in a predetermined second position and a predetermined second orientation such that the following predetermined second conditions are satisfied:

    said eye fixation point coincides with the center of said display area,

    said left eye is at a predetermined second distance from said display area, and

    said first axis and said second axis of said right eye reference system are parallel respectively to said first axis and said second axis of said display reference system;

    C) determining
    for said at least one first portion of video frame of said at least one first video frame, one or more first digital filters configured to modify the value of one or more pixels of said at least one first portion of video frame, each of which is associated with a respective predetermined first portion of video frame, and/or
    for said at least one second portion of video frame of said at least one first video frame, one or more second digital filters configured to modify the value of one or more pixels of said at least one second portion of video frame, each of which is associated with a respective predetermined second portion of video frame;

    D) configuring
    for the right eye, a first correction scheme or right correction scheme comprising said one or more first digital filters, wherein said right correction scheme is a first data structure configured to modify said at least one first portion of video frame, wherein said first data structure comprises information relating to said one or more first digital filters, information relating to said shape, said size and position of each of said first portions of video frame, and information relating to the associations of said first portions of video frame to each of said first digital filters; said right correction scheme having a graphic format so as to be displayed with a predetermined first image, wherein one or more portions of said predetermined first image are associated with a respective first digital filter and each first digital filter is associated with a respective predetermined first portion of video frame,
    and/or
    for the left eye, a second correction scheme or left correction scheme comprising one or more second digital filters, wherein said left correction scheme is a second data structure configured to modify said at least one second portion of video frame, wherein said second data structure comprises information relating to said one or more second digital filters, information relating to said shape, said size and position of each of said second portions of video frame, and information relating to the associations of said second portions of video frame to each of said second digital filters; said left correction scheme having a graphic format so as to be displayed with a predetermined second image, wherein one or more portions of said predetermined second image are associated with a respective second digital filter and each second digital filter is associated with a respective predetermined second portion of video frame;

    E) acquiring a second digital video stream, wherein said second digital video stream comprises a succession of second video frames, said second video frames of said second digital stream being video frames referenced to a visual content that can be displayed on said display area;

    F) calculating
    for said right eye a first position of the origin and a first orientation of said right eye reference system relative to said display reference system, and/or
    for said left eye, a second position of the origin and a second orientation of said left eye reference system with respect to said display reference system;

    G) comparing
    with reference to said right eye, the first position of the origin of said right eye reference system with said predetermined first position of the origin in the predetermined first conditions to verify whether said first position of the origin of said right eye reference system is different from said predetermined first position and/or said first orientation of said right eye reference system with said predetermined first orientation in the predetermined first conditions to verify whether said first orientation is different from said predetermined first orientation and/or
    with reference to said left eye, the second position of the origin of said left eye reference system with the predetermined second position of the origin in the predetermined second conditions to verify if said second position of the origin is different from said predetermined second position and/or the second orientation of said left eye reference system with said predetermined second orientation in the predetermined second conditions to verify whether said second orientation is different from said predetermined second orientation;

    H) when said first position of the origin of said right eye reference system is different from said predetermined first position of the origin and/or said first orientation of said right eye reference system is different from said predetermined first orientation, reconfiguring said right correction scheme based on said first position of the origin and/or said first orientation, such that said one or more first digital filters are applied to respective first portions of video frame, different from said predetermined first portions of video frame, and/or
    when said second position of the origin of said left eye reference system is different from said predetermined second position of the origin and/or said second orientation is different from said predetermined second orientation, reconfiguring said left correction scheme according to said second position of the origin and/or said second orientation, so that one or more second digital filters are applied to one or more respective second portions of video frame, different from said predetermined second portions of video frame;

    I) applying
    said right correction scheme to at least one second video frame of said second digital video stream so that one or more first digital filters are applied to at least one first portion of video frame so as to obtain a third digital video stream or right digital stream for the right eye, different from said second digital video stream, wherein said right digital stream comprises at least one second modified video frame, and/or
    said left correction scheme to at least one second video frame of said second digital video stream so that said one or more second digital filters are applied to at least one second portion of video frame so as to obtain a fourth digital video stream or left digital stream for the left eye, different from said second digital video stream, wherein said left digital stream comprises at least one further second modified video frame;

    L) generating a multiview digital video stream comprising a first sequence of video frames associated with said second digital video stream or said right digital video stream, and a second succession of video frames associated with said second digital video stream or said left digital video stream;

    M) displaying said multiview digital video stream by said stereoscopic or autostereoscopic video system so that said first sequence of video frames of said multiview digital video stream is viewed from said right eye and said second succession of video frames of said multiview digital video stream is seen from that left eye.



    [0055] When said right eye and/or said left eye move and/or the head of said person moves, said method may further comprise the following steps:

    F) calculating
    for said right eye a further first position of the origin and a further first orientation of said right eye reference system relative to said display reference system, and/or
    for said left eye, a further second position of the origin and a further second orientation of said left eye reference system with respect to said display reference system;

    G1) comparing
    said further first position of the origin of said right eye reference system with said predetermined first position of the origin in the predetermined first conditions to verify whether said further first position of the origin of said right eye reference system is different from said predetermined first position and/or said further first orientation of said right eye reference system with said predetermined first orientation in the predetermined first conditions to verify whether said further first orientation is different from said predetermined first orientation and/or
    said further second position of the origin of said left eye reference system with said predetermined second position of the origin in the predetermined second conditions to verify if said further second position of the origin is different from said predetermined second position and/or said further second orientation of said left eye reference system with said predetermined second orientation in the predetermined second conditions to verify whether said further second orientation is different from said predetermined second orientation;

    G2) for said right eye comparing
    said further first position of the origin of said right eye reference system with said first position to verify whether said further first position of the origin is different from said first position of the origin when said further first position of the origin of said right eye reference system is different from said predetermined first position of the origin in the predetermined first conditions, and/or said further first orientation of said right eye reference system with said first orientation to verify whether said further first orientation is different from said first orientation, when said further first orientation of said right eye reference system is different from said predetermined first orientation in the predetermined first conditions,
    and/or
    for said left eye comparing
    said further second position of the origin of said left eye reference system with said second position of the origin to verify whether said further second position of the origin is different from said second position of the origin, when said further second position of the origin of said left eye reference system is different from said predetermined second position of the origin in the predetermined second conditions, and/or said further second orientation of said left eye reference system with said second orientation to verify whether said further second orientation is different from said second orientation, when said further second orientation of said left eye reference system is different from said predetermined second orientation in the predetermined second conditions;

    H') reconfiguring said right correction scheme according to said further first position of the origin as calculated, when said further first position of the origin of said right eye reference system is different from said first position of the origin and/or based on said further first calculated orientation, when said further first orientation is different from said first orientation, and/or
    reconfiguring said left correction scheme according to said further second origin position as calculated when said further second position of the origin of said left eye reference system is different from said second position of the origin and/or based on said further second orientation as calculated, when said further second orientation is different from said second orientation.



    [0056] With reference to each of said first video frames, each of said first video frames may be an Amsler grid.

    [0057] With reference to each first digital filter and each second digital filter, each first digital filter can be graphically represented in a respective portion of said predetermined first image of said right correction scheme and each second digital filter can be represented graphically in a respective further portion of said predetermined second image of said left correction scheme.

    [0058] With reference to the visual content of the second digital video stream, such visual content may be an image or a television broadcast or a live video or a recorded video or a video output of a computer.

    [0059] The present invention also relates to a system for modifying one or more video frames of a digital video stream displayable on a display area, said system comprising:
    • a first digital video source configured to provide a first digital video stream comprising a succession of first video frames, in respect of which said one or more first digital filters and/or said one or more second digital filters are determined,
    • a second video source configured to provide a second digital video stream, wherein said second digital video stream comprises a succession of second video frames; said second video frames of said second digital stream being referred to a visual content displayable on said display area;
    • a tracking system for tracking an eye fixation point in the display area, configured at least to calculate:

      for the right eye a first position of the origin and a first orientation of a right eye reference system with respect to a display reference system, said right eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said right eye, having an origin in the center of the cornea of said right eye and comprising a first axis, a second axis and a third axis, wherein said second axis is orthogonal to an interpupillary axis, wherein said interpupillary axis is a straight line through the center of the cornea of the right eye and the center of the cornea of the left eye, and said third axis coincides with a first visual axis, wherein said first visual axis is a straight line passing through the center of the right eye cornea and said eye fixation point, a display reference system is associated with said display area, said display reference system being a three-dimensional Cartesian reference system having an origin in the center of said display area and comprising a first axis, a second axis, and a third axis, wherein said first axis is horizontal and said third axis is perpendicular to a display plane, wherein said display plane is a plane passing through said display area arranged such that said display area belongs to said display plane,

      and/or

      for the left eye, a second position of the origin and a second orientation of said left eye reference system relative to said display reference system, said left eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said left eye, having an origin in the center of the cornea of said left eye and comprising a first axis, a second axis and a third axis, wherein said second axis is orthogonal to said interpupillary axis and said third axis coincides with a second visual axis, wherein said second visual axis is a straight line through the center of the cornea of said left eye and through said eye fixation point;

      • a correction device adapted to modify the video frames of a digital video stream on the basis of visual defects perceived due to a degenerative retinal disease in which a first correction scheme or right correction scheme is stored, comprising one or more first digital filters configured to modify the value of one or more pixels of at least one first portion of video frame, wherein each first digital filter is associated with at least one predetermined first portion of video frame, and/or a second correction scheme or left correction scheme comprising one or more second digital filters configured to modify the value of one or more pixels of at least one second portion of video frame, wherein each second digital filter is associated with at least one predetermined second portion of video frame, said right correction scheme being a first data structure including information relating to said one or more first digital filters, information relating to the shape, size, and position of at least one first portion of video frame at which at least one first visual defect is perceived by a person, and information relating to the associations of said first portions of video frame to each of said first digital filters; said right correction scheme having a graphic format so as to be displayed with a predetermined first image, wherein one or more portions of said predetermined first image are associated with a respective first digital filter and each first digital filter is associated with a respective predetermined first portion of video frame, said left correction scheme being a second data structure comprising information relating to said one or more second digital filters, information relating to shape, size, and position of at least one second portion of video frame at which at least one second visual defect is perceived by a person, and information relating to the associations of said second portions of video frame to each of said second digital filters; said left correction scheme being a second data structure comprising information relating to said one or more digital filters, information relating to shape, size and position of at least one second portion of video frame at which at least one second visual defect is perceived by a person, and information relating to the associations of said second portions of video frame to each of second digital filters; said left correction scheme having a graphic format so as to be displayed with a predetermined second image, wherein one or more portions of said predetermined second image are associated to a respective second digital filter and each second digital filter is associated to a respective predetermined second portion of video frame;
      • a stereoscopic or autostereoscopic video system, wherein said stereoscopic or autostereoscopic video system comprises a display device provided with said display area.



    [0060] In particular, said correction device is connected to said first video source and said second video source as well as to said tracking system and to said stereoscopic or autostereoscopic video system and is configured at least for:

    ∘ acquiring said second digital video stream, wherein said second digital video stream comprises a succession of second video frames;

    ∘ receiving from said tracking system
    with reference to said right eye, said first position of the origin and/or said first orientation of said right eye reference system, and/or
    with reference to said left eye, said second position of the origin and/or said second orientation of a left eye reference system;

    ∘ comparing
    with reference to said right eye, said first position of the origin of said right eye reference system with a predetermined first position of the origin to verify whether said first position of the origin is different from said predetermined first position, and/or said first orientation of said right eye reference system with a predetermined first orientation to verify whether said first orientation is different from said predetermined first orientation, said predetermined first position of the origin and said predetermined first orientation being such that the following predetermined first conditions are satisfied:

    • said eye fixation point coincides with the center of said display area,
    • said right eye is at a predetermined first distance from said display area, and
    • said first axis and said second axis of said right eye reference system are parallel respectively to said first axis and said second axis of said display reference system;
    and/or
    with reference to said left eye, said second position of the origin of said left eye reference system with a predetermined second position of the origin to verify whether said second position of the origin is different from said predetermined second position and/or said second orientation of said left eye reference system with a predetermined second orientation to verify whether said second orientation is different from said predetermined second orientation, said predetermined second position of the origin and said predetermined second orientation being such that the following predetermined second conditions are satisfied:
    • said eye fixation point coincides with the center of said display area,
    • said left eye is at a predetermined second distance from said display area, and
    • said first axis and said second axis of said left eye reference system are parallel respectively to said first axis and said second axis of said display reference system;

    ∘ reconfiguring said right correction scheme according to said first position of the origin and/or said first orientation so that said one or more first digital filters are applied to respective first portions of video frame different from said predetermined first portions of video frame, when said first position of the origin of said right eye reference system is different from said predetermined first position of the origin and/or said first orientation of said right eye reference system is different from said predetermined first orientation and/or reconfiguring said left correction scheme according to said second position of the origin and/or said second orientation so that one or more second digital filters are applied to one or more respective second portions of video frame different from said predetermined second portions of video frame, when said second position of the origin of said left eye reference system is different from said predetermined second position of the origin and/or said second orientation is different from said predetermined second orientation;

    ∘ applying
    said right correction scheme to at least one second video frame of said second digital video stream so that one or more first digital filters are applied to at least one first portion of video frame so as to obtain a third digital video stream or right digital stream for the right eye, different from said second digital video stream, wherein said right digital stream comprises at least one second modified video frame, and/or
    said left correction scheme to at least one second video frame of said second digital video stream so that said one or more second digital filters are applied to at least one second portion of video frame so as to obtain a fourth digital video stream or left digital stream for the left eye, different from said second digital video stream, wherein said left digital stream comprises at least one further second modified video frame;

    ∘ generating a multiview digital video stream comprising a first sequence of video frames associated with said second digital video stream or said right digital video stream, and a second succession of video frames associated with said second digital video stream or said left digital video stream;

    ∘ performing a video coding compatible with said stereoscopic or autostereoscopic video system;

    said stereoscopic or autostereoscopic video system is configured to:

    ∘ receive said multiview digital video stream,

    ∘ display said multiview digital video stream so that said first sequence of video frames of said multiview digital video stream is viewed from said right eye and said second succession of video frames of said multiview digital stream is seen from that left eye.



    [0061] With reference to the right correction scheme and the left correction scheme, said right correction scheme may include a plurality of first digital filters, and said left correction scheme may include a plurality of said second digital filters.

    [0062] With reference to each first digital filter and each second digital filter, each first digital filter can be graphically represented in a respective portion of said predetermined first image of said right correction scheme and each second digital filter can be represented graphically in a respective further portion of said predetermined second image of said left correction scheme.

    [0063] In particular, said first video source may be said second video source, so that said system has only one video source.

    [0064] Similarly to the method, with reference to the system, said visual content of said second digital video stream may be a frame or a television broadcast or a live video or a recorded video or a video output of a computer.

    [0065] The present invention will now be described, by way of illustration, but not by way of limitation, according to one embodiment, with particular reference to the accompanying drawings, in which:

    Figure 1 schematically shows both the system and the method of the invention;

    Figure 2 shows a flow diagram of the method for modifying one or more video frames of a digital video stream that is displayed on a display area according to the invention;

    Figure 3A schematically shows the right eye that looks at a display area as well as a first correction scheme for modifying at least one video frame portion of a digital video stream based on the visual defects of the right eye, and the eye fixation point which coincides with the origin of the display reference system associated with the display area;

    Figure 3B schematically shows the left eye looking at a display area as well as a second correction scheme for modifying at least one video frame portion of a digital video stream based on visual defects of said left eye, and the eye fixation point coincides with the origin of the display reference system associated with the display area;

    Figure 4 schematically illustrates the situation in which, with reference to the right eye, the eye fixation point has shifted from the original position and is at a point different from the origin of the display reference system and a rototranslation has been applied to the first correction scheme;

    Figure 5 shows the situation in which said first rototranslated correction scheme has been projected on a display plane passing through the display area according to the direction of the first visual axis and a first image including the points of the display plane included in the display area;

    Figure 6 schematically shows the situation where, with reference to the left eye, the eye fixation point has moved from the original position and is at a different point from the origin of the display reference system and a rototranslation to the second correction scheme has been applied;

    Figure 7 shows the situation in which said second rototraslated correction scheme has been projected on a display plane passing through the display area according to the direction of the second visual axis and a second image is shown including the points of the display plane included in the display area;

    Figure 8 shows an image provided by a video origin and displayed on a display area;

    Figures 9A, 9B and 9C show the same frame as in Figure 8 as it would be perceived by a person suffering from a degenerative retinal disease that looks at the center of said image, respectively with the only right eye, with only the left eye and both eyes;

    Figures 10A and 10B show respectively the first correction scheme and the second correction scheme, each comprising a respective digital filter;

    Figures 11A and 11B respectively show the effect of the first digital filter of the first correction scheme and the effect of the second digital filter of the second correction scheme;

    Figures 12A and 12B respectively show the perceived image after applying the first correction scheme and the perceived image after the application of the second correction scheme when a person suffering from a degenerative retinal disease looks at the center of said image with the only right eye and with the only left eye;

    Figure 12C shows the frame of Figure 8 as it would be perceived by a person suffering from a degenerative retinal disease that looks at the center of said image with both eyes.



    [0066] With reference to the figures, a method for modifying one or more video frames of a digital video stream that is displayed on a display area is shown.

    [0067] Before entering the merit of the method, it should be stated that:

    Video source means any electronic device capable of providing a digital video stream comprising a plurality of video frames, such as cameras or computers or receiving means for receiving television signals; in other words, video source means a digital video source;

    Digital video stream means a succession of digital video frames;

    A display area is an area for displaying a digital video stream, such as the area of a television screen or computer monitor;

    Display plane means a plane passing through the display area arranged so that said display area belongs to said display plane, i.e. the plane to which said display area belongs;

    Eye fixation point means the point of the display area that is observed by a user at a given instant;

    First visual axis is a straight line through the center of the cornea of the right eye and through the eye fixation point;

    Second visual axis is a straight line through the center of left eye cornea and for through eye fixation point;

    Interpupillary axis is a straight line through the center of the right eye's cornea and through the center of the left eye cornea;

    Display reference system is a three-dimensional Cartesian reference system having an origin O in the center of said display area and comprising a first axis x, a second axis y, and a third axis z, wherein said first axis x is horizontal and said third axis z is perpendicular to the display plane;

    The first eye reference system or right eye reference system means a three-dimensional Cartesian reference system, integral with the right eye bulb, having an origin O1 in the center of the cornea of said right eye and comprising a first axis x1, a second axis y1 and a third axis z1, wherein said second axis y1 is orthogonal to said interpupillary axis and said third axis z1 coincides with said first visual axis;

    The second eye reference system or left eye reference system refers to a three-dimensional Cartesian reference system, integral to the left eye bulb, having an origin O2 in the center of the cornea of said left eye and comprising a first axis x2, a second axis y2 and a third axis z2, wherein said second axis y2 is orthogonal to said interpupillary axis and said third axis z2 coincides with said second visual axis;

    The first digital filter is meant as a first sequence of operations on one or more pixels configured to modify the value of said one or more pixels of at least one first portion of video frame of a digital video stream according to a predetermined first algorithm, such as an algorithm for varying the brightness or algorithm for varying one or more levels of gray or an algorithm for introducing a blur effect or a distorting effect;

    Second digital filter means a second sequence of operations on one or more pixels configured to modify the value of said one or more pixels of at least one second portion of video frame of a digital video stream according to a predetermined second algorithm, such as an algorithm for varying the brightness or algorithm for varying one or more levels of gray or an algorithm for introducing a blur effect or a distorting effect;

    The first correction scheme or right correction scheme is meant a first data structure configured to modify said at least one first portion of video frame of a digital video stream based on visual defects in the right eye,

    Wherein said first data structure comprises information relating to one or more first digital filters, information relating to the shape, size and position of each of said first portions of video frame relative to the display reference system, and information relating to the association of said first portions of video frame to each of said first digital filters, wherein the shape, size, and position of each of said first portions of video frame are detected when said right eye reference system has the origin O1 at a predetermined first position and a predetermined first orientation such to meet the following predetermined first conditions:

    The eye fixation point coincides with the center of the display area,

    Said right eye is at a predetermined first distance from said display area, and

    The first axis x1 and the second axis y1 of said right eye reference system are parallel to the first axis x and to the second axis y of said display reference system, consequently the third axis z1 of said right eye reference system is aligned with the third axis z of the display reference system;

    Said right correction scheme having a graphic format so as to be displayed with a predetermined first image, one or more portions of said predetermined first image being associated with a respective first digital filter and each first digital filter being associated with a respective predetermined first portion of video frame;

    With a second correction scheme or left correction scheme is meant a second data structure configured to modify said at least one second portion of video frame of a digital video stream based on visual defects in the left eye, wherein said second data structure comprises information relating to one or more second digital filters, information about shape, size, and position of each of said second portions of video frame relative to the display reference system and information relating to the associations of said second portions of video frame to each of said second digital filters, wherein the shape, size, and position of each of said second portions of video frame are detected when said left eye reference system has the origin O2 at a predetermined second position and a predetermined second orientation to meet the following predetermined second conditions:

    The eye fixation point coincides with the center of the display area,

    Said left eye is at a predetermined second distance from said display area, and

    The first axis x2 and the second axis y2 of said second eye reference system are parallel to the first axis x and to the second axis y of said display reference system, consequently the third axis z2 of said left eye reference system is aligned with the third axis z of the display reference system; said left correction scheme having a graphic format so as to be displayed with a predetermined second image, one or more portions of said predetermined second image being associated with a respective second digital filter and each second filter being associated with one or more predetermined second portions video frame;

    Tracking system is a system for tracking the eye fixation point of each eye, configured to calculate a first position of the origin O1 and a first orientation of the right eye reference system with respect to the display reference system, and a second position of the origin O2 and a second orientation of the left eye reference system with respect to the display reference system;

    Correction device means a device designed to modify video frames of a digital video stream based on visual defects caused by the retinal degenerative pathology, configured for:

    ∘ acquiring a digital video stream,

    ∘ memorizing said right correction scheme and/or said left correction scheme,

    ∘ receiving from said tracking system
    With reference to said right eye, said first position of the origin O1 and/or said first orientation of said right eye reference system, and/or
    With reference to said left eye, said second position of the origin O2 and/or said second orientation of a left eye reference system;

    ∘ verifying

    • If the first position of the origin O1 and the first orientation of the right eye reference system are respectively different from the predetermined first position of the origin O1 and from the predetermined first orientation of the right eye reference system in the predetermined first conditions, and/or
    • If the second position of the origin O2 and the second orientation of the left eye reference system are different from the predetermined second position of the origin O2 and from the predetermined second orientation of the left eye reference system itself in the predetermined second conditions;

    ∘ reconfiguring, with reference to the right eye reference system, the right correction scheme when the first position of the origin O1 is different from the predetermined first position of the origin O1 and/or when the first orientation is different from the predetermined first orientation, and/or reconfiguring, with reference to the left eye reference system, the left correction scheme when the second position of the origin O2 is different from the predetermined second position of the origin O2 and/or the second orientation is different from the predetermined second orientation,

    ∘ applying said right correction scheme to at least one video frame of said digital video stream, so as to modify one or more video frames of said digital video stream and generate a modified digital video stream for the right eye and/or said left correction scheme to at least one video frame of said digital video stream, so as to modify one or more video frames of said digital video stream and generate a further modified digital video stream for the left eye, and

    ∘ generating a multiview digital video stream comprising a first succession of video frames associated with said digital video stream or said modified digital video stream, wherein said first succession of video frames is destined to the right eye, and a second succession of video frames associated with said digital video stream or said further modified digital video stream, wherein said second succession of video frames is destined to the left eye,

    ∘ transmitting said multiview digital video stream to a stereoscopic or autostereoscopic video system, said multiview digital video stream being coded according to a predetermined video coding of a known type compatible with said stereoscopic or autostereoscopic video system;

    Stereoscopic or autostereoscopic video system means any stereoscopic system (for example, a video system comprising a display device and glasses that may be passive or active in combination with said display device) or any autostereoscopic system (for example, a video system comprising an autostereoscopic display device) for reproducing a digital video stream over said display area, said stereoscopic or autostereoscopic video system having said display area and is configured to:

    ∘ receiving said multiview digital video stream input, and

    ∘ visualizing said multiview digital video stream so that this first succession of video frames of said multiview digital video stream be seen by the right eye and the second succession of video frames of said multiview digital video stream be seen by the left eye.



    [0068] With reference to figure 1, both the system and the method subject matter of the invention is shown schematically, for modifying one or more digital video frames of a video stream in such a way as to correct and/or mitigate the perception of visual defects due to a degenerative disease.

    [0069] In a first box of Figure 1 (top left), a first digital video stream FD1, generated by a first video source SV1, comprising a plurality of first video frames FD11, FD12... FD1N and a person who looks at the display area A of a video system 7 are shown.

    [0070] In the illustrated embodiment, said video system 7 is a stereoscopic video system, wherein said stereoscopic system comprises a display device 71 having said display area and a spectacle 72 compatible with said display device 71. In particular, the person is positioned at a predetermined distance from display area A and looks at a point of said display area A.

    [0071] The point of display area A observed by said person is the eye fixation point and is indicated by reference P.

    [0072] This point is first observed only with the right eye 1 (holding the left eye 2 closed), and then only with the left eye 2 (holding the right eye 1 closed).

    [0073] When said point is observed only with the right eye 1, the right eye reference system has the origin O1 at a predetermined first position and a predetermined first orientation such that the eye fixation point P coincides with the center of the display area A, the right eye is at a predetermined first distance D1 from the display area A and the first axis x1 and the second axis y1 of the first eye reference system are parallel to the first axis x and the second axis y of the display reference system respectively. As a result, the third axis z1 of the first eye reference system is aligned to the third axis z of the display reference system.

    [0074] When said point is observed only with the left eye 2, the left eye reference system has the origin O2 at a predetermined second position and a predetermined second orientation such that the eye fixation point P coincides with the center of display area A, the left eye is at a predetermined second distance D2 from display area A and the first axis x2 and the second axis y2 of the second eye reference system are parallel to the first axis x and the second axis y of the display reference system. As a result, the third axis z2 of the second eye reference system is aligned to the third axis z of the display reference system.

    [0075] Thus, in these predetermined conditions, the following are identified:
    • The shape, the size and the position of at least one first portion of a video frame at which at least one first visual defect is perceived by a person who looks with the right eye, and
    • The shape, the size, and the position of at least one second portion of video frame at which at least one second visual defect is perceived by a person looking with the left eye.


    [0076] In these predetermined conditions, one or more first digital filters 11 are determined, each of which is associated with a respective first portion of video frame at which a first visual defect is perceived by a person, and one or more second digital filters 12, each of which is associated with a respective second portion of video frame at which a second visual defect is perceived by a person.

    [0077] In the example that is described, the right eye 1 and the left eye 2 have respectively a first retinal area and a second retinal area with a respective degenerative pathology, so that a first visual defect is perceived by a person in correspondence of a first portion of video frame and a second visual defect is perceived by the same person at a second portion of video frame.

    [0078] In the example described, a first digital filter 11 to be associated with a predetermined first portion of video frame and a second digital filter 12 to be associated with a predetermined second portion of video frame are determined.

    [0079] Additionally, a first correction scheme or right correction scheme SCDX and a second correction scheme or left correction scheme SCsx are configured, each of which comprises respectively the first digital filter 11 and the second digital filter 12 respectively.

    [0080] Graphically, each correction scheme SCDX, SCsx has a graphic format and is then displayed with a respective predetermined image.

    [0081] The predetermined first image with which said right correction scheme SCDX is displayed and the predetermined second image with which said left correction scheme SCsx is displayed are represented in Figure 1 and each of them shows the respective digital filter to be applied to a respective portion of video frame.

    [0082] In a second box of Figure 1 (top right) a second video source SV2 is shown, which generates a second digital video stream FD2 (different from said first digital video stream FD1) comprising a plurality of second video frames FD21,FD22...FD2N, and the same person who looks at a point of the display area A, different from the center of said display area A.

    [0083] In particular, said second video frames FD21,FD22...FD2N of said second digital video stream FD2 are referred to a respective visual content that is displayed on said display area (for example said second digital video stream can be a movie, or a succession of images) and the person watching the display area A with both eyes, and the eye fixation point P is moved from a first position, in which it coincided with the center of the display area A (itself coinciding with the origin O of the display reference system), to a second position, in which it coincides with a peripheral point of the display area A, far from the center of the display area A.

    [0084] The tracking system indicated by the reference numeral 5, respectively, calculates the position of the origin O1 and the orientation of the first eye reference system and the second eye reference system, with respect to the display reference system.

    [0085] A correction device 6 is connected to said second video source SV2, to said tracking system 5, as well as to said stereoscopic video system 7, and reconfigures said right correction scheme SCDX and said left correction scheme SCsx, based on the position and/or the orientation of the respective eye reference systems, calculated by the tracking system 5.

    [0086] Although a first video source SV1 and a second video source SV2 are shown in the figure and the correction device is connected to each of said video sources (although not shown), the presence of these two distinct video sources is not required.

    [0087] In fact, with reference to the system subject-matter of the invention, only one video source which can provide both the first digital video stream FD1 and the second digital video stream FD2 is sufficient, and that the correction device is connected to said video source. Consequently, said second video source SV2 may coincide with the first video source SV1, without thereby departing from the scope of the invention.

    [0088] Said correction device 6 applies said right correction scheme SCDX and said left correction scheme SCsx to at least one second video frame FD21,FD22...FD2N of the second digital video stream FD2.

    [0089] When said correction device 6 applies said right correction scheme SCDX to said at least one second video frame FD21,FD22...FD2N of the second digital video stream FD2 is generated a third digital video stream or right digital flow FD2DX, different from said second digital video stream FD2, comprising at least one second modified video frame FD21',FD22'...FD2N'.

    [0090] When said correction device 6 applies said left correction scheme SCsx to at least one second video frame FD21,FD22...FD2N of the second digital video stream FD2, a fourth digital video stream or left digital stream FD2sx different from said second FD2 digital video stream is generated, which comprises at least one further second modified video frame FD21",FD22"...FD2N".

    [0091] In addition, the correction device 6 executes a video encoding (in this case a video encoding compatible with the stereoscopic video system 7) of said right digital video stream FD2DX (or of said second digital video stream FD2 in case no right correction scheme SCDX has been applied to a second video frame of said second digital video stream FD2) and said left digital video stream FD2sx (or of said second digital video stream FD2 in case no left correction scheme SCsx has been applied to a second video frame of said second digital video stream FD2) for generating a multiview digital video stream MV which comprises a first sequence of video frames associated with said right digital video stream FD2DX (or said second digital video stream FD2) and a second succession of video frames associated with said left digital video stream FD2sx (or said second digital video stream FD2) and transmits said multiview digital video stream to a stereoscopic video system 7, connected to said correction device. In this way, said first sequence of video frames associated with said right digital video stream FDDX (or said second digital video stream FD2) is seen by the right eye 1 and said second sequence of video frames associated with said left digital video stream FDsx (or said second digital video stream FD2) is seen by the left eye 2, and the content of the video frames of each sequence of video frames is seen by a respective eye in the most correct way possible.

    [0092] Accordingly, the method of the invention comprises the following steps (Figure 2):

    A) acquiring a first digital video stream FD1, wherein said first digital video stream comprises a succession of first video frames FD11,FD12...FD1N;

    B) identifying from said first digital video stream FD1,
    for the right eye 1 the shape, size and position of at least one first portion of video frame of at least one first video frame FD11,FD12...FD1N in correspondence of which at least one first visual defect is perceived by a person, where the shape, the size and the position of said at least one first portion of video frame are determined when said right eye reference system has the origin O1 in a predetermined first position and a predetermined first orientation such that the following predetermined first conditions are met:

    the eye fixation point P coincides with the center of said display area A,

    the right eye 1 is at a predetermined first distance D1 from said display area A, and

    the first axis x1 and the second axis y1 of the first eye reference system are respectively parallel to the first axis x and the second axis y of the display reference system; and/or

    for the left eye 2 the shape, size and position of at least one second portion of video frame of at least one first video frame FD11,FD12... FD1N in correspondence of which a second visual defect is perceived by a person, where the shape, size and the position of said at least one second portion of video frame are determined when said left eye reference system has the origin O2 in a predetermined second position and a predetermined second orientation such that the following predetermined second conditions are met:

    the eye fixation point P coincides with the center of said display area A,

    the left eye 2 is at a predetermined second distance D2 from said display area A, and

    the first axis x2 and the second axis y2 of said second eye reference system are respectively parallel to the first axis x and the second axis y of said display reference system;

    C) determining (with respect to said first digital video stream FD1),
    for said at least one first portion of video frame of said at least one first video frame FD11,FD12...FDLN one or more first digital filter 11 configured to change the value of one or more pixels of said at least one first portion of video frame, each of which is associated with a respective predetermined first portion of video frame, and/or
    for said at least one second portion of video frame of said at least one first frame video FD11,FD12...FDLN one or more second digital filters 12 configured to change the value of one or more pixels of said at least one second portion of video frame, each of which is associated with a respective predetermined second portion of video frame;

    D) configuring:

    for the right eye 1, a first correction scheme or right correction scheme SCDX comprising said one or more first digital filters 11, wherein said right correction scheme SCDX has a graphic format, so as to be displayed with a predetermined first image, and wherein a respective portion of said predetermined first image is associated with said at least one first portion of video frame, and/or

    for the left eye 2, a second correction scheme or left correction scheme SCsx comprising one or more second digital filters 12, wherein said left correction scheme SCsx has a graphic format, so as to be displayed with a predetermined second image, and wherein a respective portion of said predetermined second image is associated with said at least one second portion of video frame;

    E) acquiring a second digital video stream FD2, wherein said second digital video stream FD2 comprises a succession of second video frames FD21, FD22...FD2N;

    F) calculating:

    for the right eye 1, a first position of the origin O1 and a first orientation of said right eye reference system with respect to said display reference system, and/or

    for the left eye 2, a second position of the origin O2 and a second orientation of said left eye reference system with respect to said display reference system;

    G) comparing
    the first position of the origin O1 of said right eye reference system with said predetermined first position of the origin O1 in the predetermined first conditions to verify if said first position of the origin O1 is different from said predetermined first position and/or the first orientation of said right eye reference system with said predetermined first orientation in the predetermined first conditions for verifying whether said first orientation is different from said predetermined first orientation, and/or
    the second position of the origin O2 of said eft eye reference system with the predetermined second position of the origin O2 in the predetermined second conditions for verifying if said second position of the origin O2 is different from said predetermined second position and/or the second orientation of said left eye reference system with said predetermined second orientation in the predetermined second conditions for verifying if said second orientation is different from said predetermined second orientation;

    H) when said first position of the origin O1 of said right eye reference system is different from said predetermined first position of the origin O1 and/or said first orientation of said right eye reference system is different from said predetermined first orientation, reconfiguring said right correction scheme SCDX based on said first position of the origin O1 and/or said first orientation, so that said one or more first digital filters 11 are applied to respective first portions of video frame, different from said predetermined first portions of video frame, and/or
    when said second position of the origin O2 of said left eye reference system is different from said predetermined second position of the origin O2 and/or said second orientation is different from said predetermined second orientation, reconfiguring said left correction scheme SCsx based on said second position of the origin O2 and/or said second orientation, so that one or more second digital filters 12 are applied to one or more respective second portions of video frame, different from said predetermined second portions of video frame;

    I) applying
    said right correction scheme SCDX to at least one second video frame FD21,FD22...FD2N of said second digital video stream FD2 in such a way that said one or more first digital filter 11 is/are applied to at least one first portion of video frame, so as to obtain a third digital video stream or right digital stream FD2DX intended for the right eye 1, different from said second digital video stream FD2, wherein said right digital stream FD2DX comprises at least one modified second video frame FD21', FD22'...FD2N', and/or
    said left correction scheme SCsx to at least one second video frame FD21,FD22...FD2N of said second digital video stream FD2 in such a way that said one or more second digital filters 12 is/are applied to at least one second portion of video frame, so as to obtain a fourth digital video stream or left digital stream FD2sx intended for the left eye 2, different from said second digital video stream FD2, wherein said left digital stream FD2sx comprises at least one further modified second video frame FD21", FD22"... FD2N";

    L) generating a multiview digital video stream MV comprising a first sequence of video frames associated with said second digital video stream FD2 or said right digital video stream FD2DX and a second sequence of video frames associated with said second digital video stream FD2 or said left digital video stream FD2sx;

    M) displaying said multiview digital video stream MV by means of a stereoscopic video system 7 in such a way that said first sequence of video frames of said multiview digital video stream MV is seen by the right eye 1, and that said second succession of video frames of said multiview digital stream MV is seen by the left eye 2.



    [0093] With reference to step A), it is specified that a first digital video stream FD1 is acquired, which comprises a succession of first video frames FD11,FD12...FD1N.

    [0094] In particular, said first video frames of said first digital stream FD1 can be test video frames configured to individuate the shape, the size and the position of video frame portions in correspondence of which respective visual defects (step B) are perceived and to determine digital filters to eliminate and/or mitigate the perception of said visual defects (step C).

    [0095] Each of said first video frames can be a respective Amsler grid.

    [0096] In other words, said first digital video stream is a configuration digital video stream, in the sense that on it shape, size and position of video frame portions are identified, in correspondence of which respective visual defects are perceived and digital filters for eliminating and/or mitigating the perception of said visual defects are determined.

    [0097] In particular, said first digital video stream FD1 is reproduced from a first video source SV1, which is preferably a computer, and is acquired by a correction device 6, as mentioned above, connected to said first video source.

    [0098] With reference to step B), it is specified that, with reference to the succession of first video frames, at least one first portion of video frame and/or at least one second portion of video frame is identified, in correspondence with each of them a respective visual defect being perceived by the person, when he/she looks at a display area A, with only the right eye and with only the left eye 2 respectively.

    [0099] With reference to a portion of video frame, at least one first visual defect may be perceived by a person who looks with the right eye 1. This may be caused by the presence of at least one first retina area which is affected by a first degenerative pathology.

    [0100] As an alternative or in addition to said at least one first visual defect, a second visual defect can be perceived by a person who looks at the display area A with the left eye 2. This can be caused by the presence of at least one second retina area which is affected by a second degenerative pathology.

    [0101] Each area of the retina suffering from a degenerative disease such as to cause the perception of a visual defect has a shape, a size and a position. Therefore, visual defects perceived by a person watching a first video frame FD11,FD12...FD1N of said first digital video stream FD1 are located in video frame portions corresponding to respective areas of the retina suffering from a degenerative disease.

    [0102] A degenerative disease of the retina can cause a' distorted' or' blurred' vision in correspondence of a portion of video frame, in a more or less accentuated manner.

    [0103] When the vision is "distorted", visual information relating to said video frame portion is perceived by a person as morphologically altered and/or incomplete.

    [0104] When the vision is "blurred", visual information relating to that portion of video frame is perceived by a person as obscured and/or with a reduced degree of sharpness.

    [0105] In both cases, if the retinal degenerative disease does not cause a loss of visual information in said video frame portion, the corrected visual information can be retrieved and the method, subject-matter of the invention, allows to eliminate the perception of the visual defect.

    [0106] Instead, if the degenerative disease of the retina causes a loss of visual information in said video frame portion, the correct visual information cannot be retrieved and the method of the invention allows to mitigate the perception of visual defect.

    [0107] In order to determine the shape, the size and the position of said first portion of video frame in correspondence of which a first visual defect is perceived, reference is made to a predetermined first position of the origin O1 and to a predetermined orientation of the of right eye reference system such that the above-mentioned predetermined first conditions are met.

    [0108] In particular, the eye fixation point P coincides with the center of said display area A, in turn coincident with the origin O of the reference system of the same display area A, and the first axis x1 and the second axis y1 of the first eye reference system are respectively parallel to the first axis x and the second axis y of the display reference system.

    [0109] Consequently, the third axis z1 of said first eye reference system is aligned to the third axis z of said display reference system.

    [0110] In order to determine the shape, the size and the position of said second portion of video frame in correspondence of which a second visual defect is perceived, reference is made to a predetermined second position of the origin O2 and at a predetermined second orientation of the left eye reference system such that the above-mentioned predetermined second conditions are met.

    [0111] In particular, the eye fixation point P coincides with the center of said display area A, in turn coincident with the origin O of the reference system of the same display area A, and the first axis x2 and the second axis y2 of the second eye reference system are respectively parallel to the first axis x and the second axis y of the display reference system.

    [0112] Consequently, the third axis z2 of said second eye reference system is aligned with the third axis z of the display reference system.

    [0113] With reference to step C), said one or more first digital filters 11 and/or said one or more second digital filters 12 are configured to modify the value of one or more pixels of one or more of video frame portions, according to a respective predetermined algorithm.

    [0114] As is known, the value of a pixel is a numeric value that represents the data sampled and quantized by a sensor.

    [0115] In particular, the value of a pixel can be modified according to the value of the same pixel and/or of a plurality of pixels at a predetermined distance from it or of all of the pixels of said at least one portion of said video frame.

    [0116] Each first digital filter 11 and each second digital filter 12 is determined based on the visual defect caused by the area of the retina suffering from a degenerative disease.

    [0117] It is preferable that the number of the first digital filters 11 is at least equal to the number of the first areas of the right eye retina suffering from a degenerative disease and that the number of second digital filters 12 is at least equal to the number of second areas of the left eye retina suffering from a degenerative disease of the retina.

    [0118] For example, if the right eye 1 has two areas of the retina suffering from a degenerative disease and the left eye 2 has a single area of the retina affected by a disease of the retina, at least two first digital filters 11 are provided to the right eye 1 in order to correct or mitigate the visual defect resulting from a respective area of the retina, and at least one second digital filter 12 is provided for the left eye 2 in order to correct or mitigate the visual defect resulting from said single retina area.

    [0119] With reference to step D, a respective correction scheme SCDX, SCsx is provided for each eye 1,2 and comprises a respective number of digital filters to eliminate and/or mitigate the perception of one or more visual defects in correspondence to respective portions of video frame.

    [0120] In addition, each of said correction schemes SCDX, SCsx has a graphic format so that it is displayed with a respective predetermined image.

    [0121] The fact that such correction schemes have a respective graphic format allows the respective digital filters to be represented graphically in respective portions of the respective predetermined image, on the basis of the shape, size and position of each of said video frame portions on which a respective filter must be applied.

    [0122] In other words, each first digital filter 11 belonging to said right correction scheme SCDX is graphically represented in a respective portion of said predetermined first image and each second digital filter 12 belonging to said left correction scheme SCsx is represented graphically in a respective further portion of said predetermined second image.

    [0123] So, each correction scheme SCDX, SCsx may be displayed as an image via any image viewer program able to interpret the graphic format.

    [0124] With reference to step E), a second digital video stream FD2 comprising a plurality of second video frames FD21,FD22...FD2N is provided by a second video source SV2 and acquired by a correction device 6, as mentioned above, connected to said second video source.

    [0125] Said second source SV2 can be either the first source SV1 and a source different from said first source SV1, such as a computer or a video camera or receiving means for receiving television signals, as mentioned above.

    [0126] Said second digital video stream FD2 is the digital stream that is modified in order to eliminate and/or mitigate the perception of visual defects caused by the degenerative disease of the retina so that the person suffering from such degenerative disease has a corrected or improved binocular vision of said second digital video stream FD2.

    [0127] As anticipated, said second digital video stream FD2 is relative to any visual content.

    [0128] For example, the visual content of said second video source SV2 can be an image or a recorded video (when the second video source is configured to read data stored in a storage device), a television broadcast (when the second video source is configured to receive a digital TV signal), a live video (when the second video source is configured to retrieve a video), a video output of a computer (when the second video source is configured to read data from a video card of a computer).

    [0129] Said second digital video stream FD2 is acquired by said correction device 6, connected to said second video source SV2.

    [0130] With reference to step F), it is specified that at least two parameters are calculated for each eye with respect to the display reference system:
    • a first position of the origin O1 and a first orientation of the right eye reference system, and
    • a second position of the origin O2 and a second orientation of the left eye reference system.


    [0131] Such positions and said orientations are calculated by means of a tracking system to track the eye fixation point, as mentioned above.

    [0132] For example, said tracking system can be a known type of optical tracking system and configured to calculate said parameters by means of video-oculography techniques.

    [0133] With reference to step G), the method provides for a comparison between the first position of the origin O1 of the right eye reference system, calculated by the tracking system, and the predetermined first position of the origin O1 of the same right eye reference system, and between the first orientation of the right eye reference system, calculated by the tracking system, and the predetermined first orientation of the same right eye reference system, and/or between the second position of the origin O2 of the left eye reference system, calculated by the tracking system, and the predetermined second position of the origin O2 of the same left eye reference system, and between the second orientation of the left eye reference system, calculated using the tracking system, and the predetermined second orientation of same left eye reference system.

    [0134] With reference to step H), it is specified that:

    the right correction scheme SCDX is reconfigured when the first origin position O1 of the right eye reference system is different from the predetermined first position of the same right eye reference system and/or the first orientation of the right eye reference system is different from the predetermined first orientation of the same right eye reference system, and

    the left correction scheme SCsx is reconfigured when the second origin position O2 of the left eye reference system is different from the predetermined second position of the same left eye reference system and/or the second orientation of the left eye reference system is different from the predetermined second orientation of the same left eye reference system.



    [0135] In this way, the first digital filters 11 of the right correction scheme SCDX and the second digital filters 12 of the left correction scheme SCsx are applied to respective portions of video frame, different from the above predetermined portions of video frame.

    [0136] It is necessary that each correction scheme is reconfigured to follow the movement of a respective eye, so that the digital filters of each correction scheme are always applied to video frame portions in correspondence of which a person perceives a visual defect, due to the fact that each eye has one or more retinal areas suffering from a degenerative disease.

    [0137] Reconfiguring a correction scheme means to perform a digital processing of the predetermined image associated with said correction scheme as a function of the origin position of the eye reference system and/or orientation of the eye reference system.

    [0138] The processing of the predetermined image associated with the correction scheme can be carried out with different techniques and algorithms of known type.

    [0139] For example, said processing can be described by a geometrical method.

    [0140] Before going into the detail of the geometric procedure, to the right correction scheme SCDX a first three-dimensional Cartesian reference system is associated, which is identified by the triad of axes x3, y3, z3, integral with said right correction scheme, and to the left correction scheme SCsx a second three-dimensional Cartesian reference system is associated, which is identified by the triad of axes x4, y4, z4, integral with said left correction scheme.

    [0141] Each three-dimensional Cartesian reference system has a respective origin O3, O4.

    [0142] Such processing may comprise the following substeps:
    1. i) moving the right correction scheme SCDX and/or the left correction scheme SCsx integrally to the movement of the respective eye, so that the first Cartesian three-dimensional reference system and/or the second three-dimensional Cartesian reference system follows/follow the movement of the respective eye in such a way as to remain integral respectively to the first visual axis V1 and the second visual axis V2, and that the first axis x3, x4 and the second axis y3, y4 of a respective Cartesian three-dimensional reference system, respectively, are parallel to the first axis x1, x2 and the second axis y1, y2 of the respective eye reference system. Consequently, the third axis z3, z4 of the respective three-dimensional Cartesian reference system is aligned with the third axis z1, z2 of the respective eye reference system along the respective visual axis V1, V2;
    2. ii) projecting said right correction scheme SCDX on the display plane according to the direction of the first visual axis V1, and/or said left correction scheme SCsx on the display plane according to the direction of the second visual axis V2;
    3. iii) selecting the plurality of points in the display plane included in the display area A in order to obtain the respective reconfigured correction scheme according to the origin position of the respective eye reference system and/or the orientation of said eye reference system.


    [0143] In the example that is described, a first group of geometric transformations is applied to the right correction scheme SCDX to reconfigure said right correction scheme and/or a second group of geometric transformations is applied to the left correction scheme SCsx to reconfigure said left correction scheme.

    [0144] Geometric transformations allow to adjust the position and/or orientation of the respective correction scheme to the variation of the origin position of the respective eye reference system and/or orientation of said eye reference system, with respect to the predetermined conditions mentioned above, under which shape, size and position of one or more first portions of video frame and/or one or more second portions of video frame are identified, in correspondence of which a respective visual defect is perceived by a person.

    [0145] With reference to the right correction scheme SCDX, when the predetermined first conditions are no longer satisfied, said first group of geometric transformations may include the following geometric transformations:

    at least one shift of the right correction scheme so that the origin O3 of the three-dimensional Cartesian reference system, associated and integral with said right correction scheme SCDX, be in any point in space which is different from the origin O of said display reference system, where said point can be outside the display plane as not belonging to it, and/or

    at least one rotation of said right correction scheme or said shifted right correction scheme so that the first axis x3 and the second axis y3 of the three-dimensional Cartesian reference system, associated and integral with said right correction scheme SCDX, are parallel respectively to first axis x1 and the second axis y1 of the right eye reference system.



    [0146] In addition, when said first group of geometric transformations places said right correction scheme SCDX on a plane different from the display plane (i.e. the plane in which the display area is), said first group of geometric transformations includes a projection of said shifted right correction scheme or of said rotated right correction scheme or said rotated and translated right correction scheme onto said display plane according to the direction of said first visual axis.

    [0147] Because of said first group of geometric transformations, a first part of said right correction scheme SCDX comprising a first plurality of points may fall within the display area and a second part of said right correction scheme SCDX comprising a second plurality of points may fall outside the display area.

    [0148] With reference to the left correction scheme SCsx, when the predetermined second conditions are no longer fulfilled, said second group of geometric transformations may include the following geometric transformations:

    at least one translation of the left correction scheme so that the origin O4 of the second three-dimensional Cartesian reference system, associated and integral with said left correction scheme, be in any point in space, different from the origin O of said reference system display, wherein said point may be a point external to the display plane as not belonging to it, and/or

    at least one rotation of said left correction scheme or said shifted left correction scheme so that the first axis x4 and the second axis y4 of the second Cartesian reference system, associated and integral with said left correction scheme, are respectively parallel to the first axis x2 and the second axis y2 of the left eye reference system.



    [0149] In addition, when said second group of geometric transformations places said left correction scheme SCsx on a plane different from the display plane (i.e. the plane to which the display area belongs), said second group of geometric transformations comprises a projection of said shifted left correction scheme or said rotated left correction scheme or said rotated and shifted left correction scheme onto said display plane according to the direction of said second visual axis.

    [0150] Because of said second group of geometric transformations, a first part of said left correction scheme SCsx comprising a third plurality of points may fall within the display area and a second part of said left correction scheme SCsx comprising a fourth plurality of points may fall outside the display area.

    [0151] With reference to phase I), it is specified that from said second digital video stream FD2 a third digital video stream or the right digital stream FD2DX and/or fourth digital video stream or left digital stream FD2sx can be generated, by the application by said correction device 6 of a respective correction scheme SCDX, SCsx to at least one second video frame FD21,FD22...FD2N of said second digital video stream FD2.

    [0152] In the case in which the right eye 1 has no retinal area suffering from a degenerative pathology, the right digital stream FD2DX coincides with the digital video stream FD2 and in the case in which the left eye 2 does not have any area of the retina affected from a degenerative disease, the left digital stream FD2sx coincides with the digital video stream FD2.

    [0153] Advantageously, said right digital flow FD2DX and said left digital stream FD2sx are intended for the right eye 1 and left eye 2, respectively, in such a way that the perceived visual defects resulting from one or more first retina areas of the right eye 1, suffering from a degenerative disease, and/or the perceived visual defects resulting from one or more second retina areas of the left eye 2, suffering from a further degenerative disease, can be eliminated and/or attenuated.

    [0154] A further advantage is given by the fact that the perceived visual defects due to one or more first retina areas of the right eye, suffering from a degenerative disease, can be eliminated and/or attenuated independently by the perceived visual defects due to one or more second retina areas of the left eye, suffering from a degenerative disease.

    [0155] With reference to the steps L) and M), it is specified that a multiview digital video stream MV is generated that comprises:
    • a first succession of video frames associated with the second digital video stream FD2 (in case no right correction scheme SCDX is applied to a second video frame FD21,FD22...FD2N of said second digital video stream FD2) or to said right digital video stream FD2DX (in case the right correction scheme SCDX is applied to at least one second video frame FD21,FD22...FD2N of said second digital video stream FD2), and
    • a second succession of video frames associated with the second digital video stream FD2 (in case no left correction scheme SCsx is applied to a second video frame FD21,FD22...FD2N of said second digital video stream FD2) or to said left digital video stream FD2sx (in case the left correction scheme SCsx is applied to at least one second video frame FD21,FD22...FD2N of said second digital video stream FD2).


    [0156] In particular, said multiview digital video stream MV is generated by said correction device 6 that is configured to perform a known type of video encoding process compatible with the stereoscopic video system 7.

    [0157] In this way, said multiview digital video stream MV is encoded in such a way as to be compatible with the stereoscopic video system 7, connected to said correction device 6.

    [0158] Said multiview digital video stream MV is transmitted by said correction device 6 to said stereoscopic video system 7 and, thanks to the stereoscopic video system, said multiview digital video stream MV is displayed on the display area in such a way that the first sequence of video frames is seen by the right eye 1 and the second sequence of video frames is seen by the left eye 2.

    [0159] In other words, said stereoscopic video system 7 is only a means by which it is possible to convey a respective succession of video frames to a respective eye.

    [0160] The same is true if the video system 7 is autostereoscopic.

    [0161] Advantageously, each eye sees a respective image changed according to the respective visual defects, so that a person who looks with both eyes perceives an image in which the visual defects, perceived because of retinal areas suffering from a degenerative disease, are eliminated and/or attenuated.

    [0162] In an alternative, although not shown in the figures, said video system 7 may be an autostereoscopic video system, without thereby departing from the scope of the invention.

    [0163] When the video system is autostereoscopic, the person must occupy a predetermined position with respect to the display area of said autostereoscopic video system, in terms of distance and person's face angle with respect to said display area.

    [0164] In particular, the distance and the angle with which the said person looks at said display area must be such that said first sequence of video frames of said multiview digital video stream MV is seen by the right eye 1, and that said second succession of video frames of said multiview digital stream MV is seen by the left eye 2.

    [0165] In addition, the correction device 6 is configured to perform a video encoding compatible with said autostereoscopic video system.

    [0166] With reference to the steps of the above described method, if the person moves further the right eye 1 and/or the left eye 2, both the eyes and/or the head, said method may further comprise the following steps:

    F') calculating
    for the right eye 1, a further first position of the origin O1 and a further first orientation of said right eye reference system with respect to said display reference system, and/or
    for the left eye 2, a further second position of the origin O2 and a further second orientation of said left eye reference system with respect to said display reference system;

    G1) comparing
    said further first position of the origin O1 of said right eye reference system with said predetermined first position of the origin O1 in the predetermined first conditions to verify if said further first position of the origin O1 of said right eye reference system is different from said predetermined first position and/or said further first orientation of said right eye reference system with said predetermined first orientation in the predetermined first conditions to verify if said further first orientation is different from said predetermined first orientation, and/or
    said further second position of the origin O2 of said left eye reference system with said predetermined second position of the origin O2 in the predetermined second conditions to verify if said further position of the origin O2 is different from said predetermined second position and/or said further second orientation of said left eye reference system with said predetermined second orientation in the predetermined second conditions to verify if said further second orientation is different from said predetermined second orientation;

    G2) for the right eye, comparing:

    said further first position of the origin O1 of said right eye reference system with said first position to verify if said further first position of the origin O1 is different from said first position of the origin O1, when said further first position of the origin O1 of said right eye reference system is different from the predetermined first position of the origin O1 in the predetermined first conditions, and/or

    said further first orientation of said right eye reference system with said first orientation to verify if said further first orientation is different from said first orientation, when said further first orientation of said right eye reference system is different from the predetermined first orientation in the predetermined first conditions,

    and/or

    for the left eye, comparing

    said further second position of the origin O2 of said left eye reference system with said second position of the origin to verify if said further second position of the origin O2 is different from said second position of the origin O2, when said further second position of the origin O2 of said left eye reference system is different from said predetermined second position of the origin O2 in the predetermined second conditions, and/or

    said further second orientation of said left eye reference system with said second orientation to verify if said further second orientation is different from said second orientation when said further second orientation of said left eye reference system is different from said predetermined second orientation in the predetermined first conditions;

    H') reconfiguring said right correction scheme SCDX based on said further first position of the origin O1 as calculated, when said further first position of the origin O1 of said right eye reference system is different from said first position of the origin O1, and/or, on the basis of said further first orientation as calculated, when said further first orientation is different from said first orientation, and/or
    reconfiguring said left correction scheme SCsx based on said further second position of the origin O2 as calculated, when said further second position of the origin O2 of said left eye reference system is different from said second position of the origin O2, and/or on the basis of said further second orientation as calculated, when said further second orientation is different from said second orientation.



    [0167] With reference to Figures 3A onwards, some steps of the method are shown, once the right correction scheme SCDX and the left correction scheme SCsx have been configured respectively for the right eye 1 and for the left eye 2, when the predetermined conditions mentioned above are verified.

    [0168] In the example that is described, each eye has respectively a first retinal area and a second retinal area affected by a respective degenerative pathology.

    [0169] Consequently, each correction scheme SCDX, SCsx respectively comprises a first digital filter 11 and a second digital filter 12.

    [0170] Depending on the perceived visual defect due to degenerative disease, it is possible to provide an appropriate digital filter.

    [0171] If the degenerative disease is such that a portion of video frame in correspondence of a retina area is perceived as distorted in a first direction without there being a loss of information, the digital filter is a digital filter with distorting effect to distort the first portion of video frame in a second direction, opposite to said first direction, to compensate for the visual defect perceived by the person. In this way, with reference to said portion of video frame, the binocular vision is corrected.

    [0172] For example, if the degenerative disease of the retina is such that a person has a distorted visual perception to the left or to the right of a portion of video frame, the digital filter is configured to distort to an extent equal to the same portion of video frame, respectively, towards the right or the left to compensate for the visual defect perceived by the person, so that the portion of the image in correspondence with said portion of video frame is seen correctly or substantially correctly.

    [0173] If the pathology is such as to cause, with reference to a portion of video frame in correspondence of a retina area, an altered visual perception that cannot be corrected, for example in the case of a distortion with loss of information, the digital filter can be a digital filter with blur effect to blur said video frame portion.

    [0174] Where a first eye is healthy (i.e. not suffering from degenerative diseases) or not suffering from degenerative disease in a retina area corresponding to the one in the second eye that is suffering from degenerative pathology, binocular vision of the image portion in correspondence of said portion of video frame produces a faded visual perception. This is due to the application of the digital filter with blur effect to eliminate the perception of visual defects of the second eye. How much this perception is faded depends on the merging process carried out by the brain that takes into consideration, with different weights, the contributions of the first eye and the second eye, which relate to the same image portion perceived corrected and blurred respectively.

    [0175] With the method of the invention, it is possible to reduce the weight of the altered informative contribution supplied by the second eye, improving the perception of the information content of said video frame portion.

    [0176] In particular, as can be seen from Figure 3A, the right eye 1 is at a predetermined first distance D1 from said display area A, and the first axis x1 and the second axis y1 of the first eye reference system are parallel respectively to the first axis x and the second axis y of the display reference system, and the third axis z1 of the first eye reference system is aligned to the third axis z of the display reference system.

    [0177] In particular, the third axis z1 of the first eye reference system and the third axis z of the display reference system are aligned along the first visual axis V1, and then the eye fixation point P coincides with the origin O of the display reference system.

    [0178] In addition, the right correction scheme SCDX is displayed with a predetermined first image, which is the graphic representation of said right correction scheme, and to the first digital filters 11 of said right correction scheme SCDX is associated with a respective portion of said predetermined first image.

    [0179] In the example that is being described, the first digital filter 11 is positioned in the vicinity of the center of the display area A with respect to whom looks at said display area.

    [0180] In Figure 3A, the right correction scheme SCDX is represented by a rectangle with a dashed line and the display area A is represented by a rectangle with continuous line.

    [0181] Said right correction scheme SCDX is superimposed to the display area A to show the correspondence between each point of the right correction scheme SCDX and a respective point of the display area A on which each video frame is displayed.

    [0182] In Figure 3A, the predetermined distance between the right eye 1 and the display area A are also shown, and the position and the orientation of the right eye reference system, as identified by the set of three axes x1, y1, z1, with respect to the display reference system, as identified by the set of three axes x, y, z.

    [0183] The eye fixation point P coincides with the center of the display area A.

    [0184] In other words, figure 3A shows the situation in which the predetermined first conditions are met.

    [0185] In such a situation, as can be seen from Figure 3A, the three-dimensional Cartesian reference system as identified by the triad of axes x3, y3, z3, integral to and associated with the right correction scheme SCDX, coincides with the display reference system.

    [0186] As can be seen from Figure 3B, the left eye 2 is at a predetermined second distance D2 from said display area A, and the first axis x2 and the second axis y2 of the second eye reference system are parallel respectively to the first axis x and the second axis y of the display reference system, and the third axis z2 of the second eye reference system is aligned to the third axis z of the display reference system.

    [0187] In particular, the third axis z2 of the second eye reference system and the third axis z of the display reference system are aligned along the second visual axis V2, and then the eye fixation point P coincides with the origin O of the display reference system.

    [0188] In addition, the left correction scheme SCsx is displayed with a predetermined second image which is the graphic representation of said left correction scheme and to the second digital filters 12 of said left correction scheme SCsx is associated with a respective predetermined portion of said second image.

    [0189] In the example that is being described, the second digital filter 12 is positioned in the vicinity of the angle formed by two consecutive sides of the display area A, in the upper left with respect to whom looks at said display area.

    [0190] In Figure 3B, similarly to Figure 3A, the left correction scheme SCsx is represented by a rectangle with a dashed line and the display area A is represented by a rectangle with continuous line.

    [0191] Said left correction scheme SCsx is superimposed to the display area A to show the correspondence between each point of the left correction scheme SCsx and a respective point of the display area on which is displayed each video frame.

    [0192] In Figure 3B, the predetermined distance between the left eye 2 and the display area A are also shown, as well as the position and the orientation of the left eye reference system, as identified by the set of three axes x2, y2, z2, with respect to the display reference system, as identified by the set of three axes x, y, z.

    [0193] The eye fixation point P coincides with the center of the display area A.

    [0194] In other words, Figure 3B shows the situation in which the predetermined second conditions are met.

    [0195] In such a situation, as can be seen from Figure 3B, the three-dimensional Cartesian reference system identified by the triad of axes x4, y4, z4, integral to and associated with the left correction scheme SCsx, coincides with the display reference system.

    [0196] In the example that is described, said right correction scheme SCDX and said left correction scheme SCsx are associated with predetermined images that have shape and size equal to those of the display area.

    [0197] With reference to Figures 4 and 5, as well as to Figures 6 and 7, the situation is shown in which the eye fixation point P has changed position on the display area A with respect to the original position where it coincided with the origin O of of display reference system.

    [0198] This can be achieved with a movement of the eyes and/or head of a person.

    [0199] With particular reference to Figure 4, the right eye 1 and the first correction scheme are shown, wherein the first correction scheme has been translated and rotated with respect to the display area A in such a way that takes into account information relating to the eye fixation point position and to orientation of the first eye reference system with respect to the display reference system.

    [0200] Accordingly, the first Cartesian system integral to and associated with the predetermined first image of the right correction scheme SCDX no longer coincides with the display reference system.

    [0201] To obtain the first image F1' displayed on said display area A shown in Figure 5, the translated and rotated correction scheme SCDX is projected onto the display plane according to the direction of the first V1 visual axis.

    [0202] Due to the translation, rotation and projection of the right correction scheme SCDX on the display plane, a first part of the predetermined first image of said first correction scheme comprising at least a first plurality of points falls within the display area A and a second part of said predetermined first image comprising a second plurality of points falls outside the display area.

    [0203] In Figure 5, the display area A and the first image F1' displayed on said display area A are shown.

    [0204] Said first image F1' comprises the points of the display plane that fall within the display area.

    [0205] As it can be seen from Figure 5, the first digital filter 11 has changed shape, size and is located in a new position, different from the original one (in the vicinity of the origin O of the display reference system). In fact, the first digital filter 11 is in a decentralized position with respect to the center of the display area A.

    [0206] With particular reference to Figure 6, the left eye 2 and the left correction scheme SCSX is shown, which has been translated and rotated with respect to the display area A in such a way that takes into account information relating to the position of the eye fixation point P and orientation of the second eye reference system with respect to the display reference system.

    [0207] Consequently, the second Cartesian system integral to and associated with the predetermined second image of the left correction scheme SCSX no longer coincides with the display reference system.

    [0208] To obtain the second image F2' displayed on said display area A shown in Figure 7, the translated and rotated left correction scheme SCSX is projected onto the display plane passing through the display area in accordance with the direction of the second visual axis V2.

    [0209] Due to the translation, rotation and projection of the left correction scheme SCSX on the display plane, a first part of said predetermined second image comprising at least a third plurality of points falls within the display area A and a second part of said predetermined second image comprising a fourth plurality of points falls outside the display area.

    [0210] In Figure 7, the display area A and the second image F2' displayed on said display area are shown.

    [0211] Said second image F2' includes the points of the display plane that fall within the display area.

    [0212] As can be seen from Figure 7, the second digital filter 12 has changed shape, size and is located in a position different from the original one. In fact, the second digital filter is in a position such that two portions of said second digital filter 12 are substantially in contact with a respective side of the display area A.

    [0213] In the example of application described above, each predetermined image of the respective correction scheme is subject to a respective group of geometric transformations comprising not only a translation and a rotation, but also a projection onto the display plane according to the respective visual axis.

    [0214] In Figure 8, an image corresponding to a video frame as provided by a video source and displayed on the display area A is shown.

    [0215] As can be seen from Figure 8, said image is an array of integers, where said numbers matrix has four rows and nine columns.

    [0216] If both eyes of a person had not one or more retinal areas suffering from a degenerative disease, the image provided by the video source would be seen and perceived by the person as shown in Figure 8.

    [0217] In Figures 9A, 9B, 9C the same image of Figure 8 is shown as it is perceived by a person who looks only with the right eye, only with the left eye and with both eyes, respectively.

    [0218] That person has the retina of each eye suffering from a respective degenerative disease that causes the perception of a respective visual disturbance, in correspondence with a respective portion of said image.

    [0219] As can be seen from Figures 9A and 9B, a right eye retina area is suffering from a degenerative disease such that the person perceives a first image portion distorted to the right, i.e. deformed but without loss of information, while a retina area of the left eye is suffering from a degenerative disease such that the person perceives a second portion of the image altered so as to have a loss of visual information in correspondence with said second portion of the image (irreversible distortion).

    [0220] When no correction scheme is applied, the binocular vision of the same image (Figure 9C) combines the two altered visual perceptions caused by degenerative diseases affecting the respective areas of the retina of the single eyes. This is due to the merging process, carried out by the brain, of the signals which from the two eyes reach the brain itself.

    [0221] In general, without going into detail of the merging process by the brain of the signals from the two eyes, and neglecting any situations that may cause a failure of said merging process, causing dynamic effects (such as image flicker, doubling of image or alternation of parts of the image) the binocular vision of the image shown in Figure 8 by the person suffering degenerative diseases of the retina described above could cause a perception of the image similar to that shown in Figure 9C, which is the result of the merger performed by the brain, with respective weights of the signals arising from the right monocular vision and left monocular vision.

    [0222] In Figures 10A and 10B, the right correction scheme SCDX and the left correction scheme SCSX are respectively shown, each of which respectively comprises a first digital filter 11 and a second digital filter 12.

    [0223] The first digital filter 11 is a digital filter with distorting effect to distort to the left a portion of the image displayed in the video framework.

    [0224] The second digital filter 12 is a digital filter with blurring effect to blur a portion of the image shown in the video frame that is perceived to be altered with a loss of information.

    [0225] Figure 11A and 11B represent respectively the images corresponding to the video frame of figure 8, as perceived by a person whose retinas are not suffering from degenerative diseases, after the application of the first digital filter 11 and the second digital filter 12.

    [0226] Figures 12A and 12B represent respectively the images corresponding to the video frame of Figure 8, as perceived by a person whose retinas are suffering from retinal degenerative diseases, when he/she looks with only the right eye 1 after the right correction scheme SCDX has been applied to the image, and when he/she looks with only the left eye 2, after the left correction scheme SCSX has been applied to the same image.

    [0227] Figure 12C shows the image corresponding to the video frame of Figure 8 as perceived by the person suffering from retinal degenerative diseases when looking with both eyes.

    [0228] In other words, the displayed image is the representation of the image perceived by said person as a result of the merger of the right eye 1 and the left eye 2 contributions.

    [0229] The fact that the binocular vision of an image is always the result of an elaboration made by the brain of the signals that both eyes send to the brain is to be considered.

    [0230] As it can be seen from Figure 12C, the perception of the first portion of the image (initially perceived as portion distorted to the right) has been corrected by the application of the right correction scheme SCDX and the perception of the second portion of the image (initially perceived as a portion whose visual information is altered with loss of information) has been made such that said second portion of the image is faded by the application of the left correction scheme SCSX.

    [0231] Advantageously, by the method and the system, subject-matter of the invention, one or more digital images of a digital video stream reproduced on a display area of a display device of an autosteroscopic or stereoscopic system are modified through respective correction schemes for the right eye and for the left eye in order to compensate for visual defects perceived by each eye of the subject suffering from a degenerative disease of the retina.

    [0232] The application of said respective correction schemes on said digital video stream allows to generate two further digital video streams (each of which is destined to a respective eye), so that the perception of visual defects in a subject suffering from a degenerative disease of the retina is deleted and/or attenuated and its binocular vision is improved.

    [0233] The present invention has been described for illustrative but not limitative purposes, according to its preferred embodiment, but it is to be understood that variations and/or modifications may be made by those skilled in the art without for this reason departing from the relative scope of protection, as defined by the appended claims.


    Claims

    1. A method for modifying one or more video frames of a digital video stream to be displayed on a display area (A),
    wherein

    - a first eye reference system or right eye reference system is associated with the right eye (1), said right eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said right eye (1), and has an origin (O1) in the center of the cornea of said right eye (1) and comprises a first axis (x1), a second axis (y1) and a third axis (z1), wherein said second axis (y1) is orthogonal to an interpupillary axis (B), wherein said interpupillary axis (B) is a straight line passing through the center of the right eye cornea (1) and to the center of the left eye cornea (2), and said third axis (z1) coincides with a first visual axis (V1), wherein said first visual axis (V1) is a straight line passing through the center of the right eye cornea (1) and an eye fixation point (P), wherein said eye fixation point (P) is a point of said display area (A) observed by a person, said display area (A) being part of a stereoscopic or autostereoscopic video system (7),

    - a second eye reference system or left eye reference system is associated with the left eye (2), said left eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said left eye (2), having an origin (O2) in the center of said left eye cornea (2) and comprising a first axis (x2), a second axis (y2) and a third axis (z2), wherein said second axis (y2) is orthogonal to said interpupillary axis (B) and said third axis (z2) coincides with a second visual axis (V2), where said second visual axis (V2) is a straight line passing through the center of said left eye cornea (2) and said eye fixation point (P),

    - a display reference system is associated with said display area (A), said display reference system being a three-dimensional Cartesian reference system having an origin (O) in the center of said display area (A) and comprising a first axis (x), a second axis (y), and a third axis (z), wherein said first axis (x) is horizontal and said third axis (z) is perpendicular to a display plane, wherein said visualization plane is a plane passing through said display area and arranged in such a way that said display area (A) belongs to said display plane,
    said method comprising the following steps:

    A) acquiring a first digital video stream (FD1), wherein said first digital video stream comprises a succession of first video frames (FD11,FD12...FD1N);

    B) identifying with respect to said first digital video stream (FD1)
    for the right eye (1) the shape, size and position of at least one first portion of video frame of at least one first video frame (FD11,FD12...FD1N) in correspondence of which at least one first visual defect is perceived by said person, wherein shape, size and position of said at least one first portion of video frame are determined when said right eye reference system has the origin (O1) in a predetermined first position and a predetermined first orientation such that the following predetermined first conditions are met:

    said eye fixation point (P) coincides with the center of said display area (A),

    said right eye (1) is at a predetermined first distance (D1) from said display area (A), and

    said first axis (x1) and said second axis (y1) of said right eye reference system are parallel respectively to said first axis (x) and

    said second axis (y) of said display reference system;
    and/or

    for the left eye (2) the shape, size and position of at least one second portion of video frame of at least one first video frame (FD11, FD12 ... FD1N) in correspondence of which at least one second visual defect is perceived by said person, where shape, size and position of said at least one second portion of video frame are determined when said left eye reference system has the origin (O2) in a predetermined second position and a predetermined second orientation such that the following predetermined second conditions are met:

    said eye fixation point (P) coincides with the center of said display area (A),

    said left eye (2) is at a predetermined second distance (D2) from said display area (A), and

    said first axis (x2) and said second axis (y2) of said left eye reference system are parallel respectively to said first axis (x) and said second axis (y) of said display reference system;

    C) determining
    for said at least one first portion of video frame of said at least one first video frame (FD11,FD12...FD1N), one or more first digital filters (11) configured to change the value of one or more pixels of said at least one first portion of video frame, each of which is associated with a respective predetermined first portion of video frame, and/or
    for said at least one second portion of video frame of said at least one first video frame (FD11,FD12...FD1N), one or more second digital filters (12) configured to change the value of one or more pixels of said at least one second portion of video frame, each of which is associated with a respective predetermined second portion of video frame;

    D) configuring
    for the right eye (1), a first correction scheme or right correction scheme (SCDX) comprising said one or more first digital filters (11), wherein said right correction scheme (SCDX) is a first data structure configured to modify said at least one first portion of video frame, wherein said first data structure comprises information relating to said one or more first digital filters (11), the information relating to said shape, size and position of each of said first portions of video frame and information relating to the associations of said first portions of video frame with each of said first digital filters (11); said right correction scheme (SCDX) having a graphic format so as to be displayed with a predetermined first image, wherein one or more portions of said predetermined first image are associated with a respective first digital filter (11) and each first digital filter (11) is associated with a respective predetermined first portion of video frame,
    and/or
    for the left eye (2), a second correction scheme or left correction scheme (SCSX) comprising one or more second digital filters (12), wherein said left correction scheme (SCSX) is a second data structure configured to modify said at least one second portion of video frame, wherein said second data structure comprises information relating to said one or more second digital filters (12), the information relating to said shape, size and position of each of said second portions of video frame and information relating to associations of said second portions of video frame with each of said second digital filters (12); said left correction scheme (SCSX) having a graphic format so as to be displayed with a predetermined second image, wherein one or more portions of said predetermined second image are associated with a respective second digital filter (12) and each second digital filter (12) is associated with a respective predetermined second portion of video frame;

    E) acquiring a second digital video stream (FD2), wherein said second digital video stream (FD2) comprises a succession of second video frames (FD21,FD22...FD2N), said second video frames (FD21,FD22...FD2N) of said second digital stream (FD2) being video frames referring to a visual content displayable on said display area (A);

    F) calculating
    for the right eye (1), a first position of the origin (O1) and a first orientation of said right eye reference system with respect to said display reference system, and/or
    for the left eye (2), a second position of the origin (O2) and a second orientation of said left eye reference system with respect to said display reference system;

    G) comparing
    with reference to said right eye (1), the first position of the origin (O1) of said right eye reference system with said predetermined first position of the origin (O1) in the predetermined first conditions to verify whether said first position of the origin (O1) is different from said predetermined first position, and/or the first orientation of said right eye reference system with said predetermined first orientation in the predetermined first conditions to verify whether said first orientation is different from said predetermined first orientation, and/or
    with reference to said left eye (2), the second position of the origin (O2) of said left eye reference system with the predetermined second position of the origin (O2) in the predetermined second conditions to verify if said second position of the origin (O2) is different from said predetermined second position, and/or the second orientation of said left eye reference system with said predetermined second orientation in the predetermined second conditions to verify if said second orientation is different from said predetermined second orientation;

    H) when said first position of the origin (O1) of said right eye reference system is different from said predetermined first position of the origin (O1) and/or said first orientation of said right eye reference system is different from said predetermined first orientation, reconfiguring said right correction scheme (SCDX) on the basis of said first position of the origin (O1) and/or said first orientation, so that said one or more first digital filters (11) are applied to respective first portions of video frame, different from said predetermined first portions of video frame, and/or
    when said second position of the origin (O2) of said left eye reference system is different from said predetermined second position of the origin (O2) and/or said second orientation is different from said predetermined second orientation, reconfiguring said left correction scheme (SCSX) based on said second position of the origin (O2) and/or said second orientation, so that one or more second digital filters (12) are applied to one or more respective second portions of video frame, different from said predetermined second portions of video frame;

    I) applying
    said right correction scheme (SCDX) to at least one second video frame (FD21,FD22...FD2N) of said second digital video stream (FD2) in such a way that one or more first digital filters (11) are applied to at least one first portion of video frame, so as to obtain a third digital video stream or right digital stream (FD2DX) for the right eye (1), different from said second digital video stream (FD2), wherein said right digital stream (FD2DX) comprises at least one second modified video frame (FD21',FD22'...FD2N'), and/or
    said left correction scheme (SCSX) to at least one second video frame (FD21,FD22...FD2N) of said second digital video stream (FD2) in such a way that said one or more second digital filters (12) are applied to at least one second portion of video frame, so as to obtain a fourth digital video stream or left digital stream (FD2SX) for the left eye (2), different from said second digital video stream (FD2), wherein said left digital stream (FD2SX) comprises at least one further second modified video frame (FD21",FD22"...FD2N");

    L) generating a multiview digital video stream (MV) comprising a first sequence of video frames associated with said second digital video stream (FD2) or said right digital video stream (FD2DX), and a second sequence of video frames associated with said second digital video stream (FD2) or said left digital video stream (FD2SX);

    M) displaying said multiview digital video stream (MV) by said stereoscopic or autostereoscopic video system (7) in such a way that said first sequence of video frames of said multiview digital video stream (MV) be seen by said right eye (1) and said second sequence of video frames of said multiview digital video stream (MV) be seen by said left eye (2).


     
    2. Method according to the preceding claim, characterized in that if said right eye (1) and/or said left eye (2) move and/or the head of said person moves, said method further comprises the following steps:

    F') calculating
    for said right eye (1), a further first position of the origin (O1) and a further first orientation of said right eye reference system with respect to said display reference system, and/or
    for said left eye (2), a further second position of the origin (O2) and a further second orientation of said left eye reference system with respect to said display reference system;

    G1) comparing
    said further first position of the origin (O1) of said right eye reference system with said predetermined first position of the origin (O1) in the predetermined first conditions to verify if said further first position of the origin (O1) of said right eye reference system is different from said predetermined first position and/or said further first orientation of said right eye reference system with said predetermined first orientation in the predetermined first conditions in order to verify if said further first orientation is different from said predetermined first orientation, and/or
    said further second position of the origin (O2) of said left eye reference system with said predetermined second position of the origin (O2) in the predetermined second conditions to verify if said further second position of the origin (O2) is different from said predetermined second position, and/or said further second orientation of said left eye reference system with said predetermined second orientation in the predetermined second conditions in order to verify if said further second orientation is different from said predetermined second orientation;

    G2) for said right eye (1), comparing
    said further first position of the origin (O1) of said right eye reference system with said first position to verify if said further first position of the origin (O1) is different from said first position of the origin (O1), when said further first position of the origin (O1) of said right eye reference system is different from said predetermined first position of the origin (O1) in the predetermined first conditions, and/or said further first orientation of said right eye reference system with said first orientation to verify if said further first orientation is different from said first orientation, when said further first orientation of said right eye reference system is different from said predetermined first orientation in the predetermined first conditions,
    and/or
    for said left eye (2), comparing
    said further second position of the origin (O2) of said left eye reference system with said second position of the origin (O2) to determine whether said further second position of the origin (O2) is different from said second position of the origin (O2), when said further second position of the origin (O2) of said left eye reference system is different from said predetermined second position of the origin (O2) in the predetermined second conditions, and/or said further second orientation of said eye left reference system with said second orientation to verify if said further second orientation is different from said second orientation when said further second orientation of said left eye reference system is different from said predetermined second orientation in the predetermined second conditions;

    H') reconfiguring said right correction scheme (SCDX) based on said further first position of the origin (O1) as calculated, when said further first position of the origin (O1) of said right eye reference system is different from said first position of the origin (O1), and/or on the basis of said further first orientation as calculated, when said further first orientation is different from said first orientation, and/or
    reconfiguring said left correction scheme (SCSX) based on said further second position of the origin (O2) as calculated, when said further second position of the origin (O2) of said left eye reference system is different from said second position of the origin (O2), and/or on the basis of said further second orientation as calculated, when said further second orientation is different from said second orientation.


     
    3. Method according to any one of the preceding claims, characterized in that each of said first video frames is an Amsler grid.
     
    4. Method according to any one of the preceding claims, characterized in that each first digital filter (11) is graphically represented in a respective portion of said predetermined first image of said right correction scheme (SCDX) and in that each second digital filter (12) is represented graphically in a respective further portion of said predetermined second image of said left correction scheme (SCSX).
     
    5. Method according to any one of the preceding claims, characterized in that said visual content of said second digital video stream (FD2) is an image or a television broadcast or a live video or a recorded video or a video output of a computer.
     
    6. System for modifying one or more video frames of a digital video stream displayable on a display area (A), said system comprising:

    - a first digital video source (SV1) configured to provide a first digital video stream (FD1), wherein said first digital video stream (FD1) comprises a succession of first video frames (FD11,FD12...FD1N); said one or more first digital filters (11) and/or said one or more second digital filters (12) being determined with respect to said first digital video stream (FD1),

    - a second video source (SV2) configured to provide a second digital video stream (FD2), wherein said second digital video stream (FD2) comprises a succession of second video frames (FD21,FD22...FD2N); said second video frames (FD21,FD22...FD2N) of said second digital stream (FD2) being related to a visual content displayable on said display area (A);

    - a tracking system (5) for tracking an eye fixation point (P) in said display area (A), at least configured to calculate:

    for the right eye (1), a first position of the origin (O1) and a first orientation of a right eye reference system with respect to a display reference system, said right eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said right eye (1), having an origin (O1) in the center of the cornea of said right eye (1) and comprising a first axis (x1), a second axis (y1) and a third axis (z1), wherein said second axis (y1) is orthogonal to an interpupillary axis (B), wherein said interpupillary axis (B) is a straight line passing through the center of the right eye cornea (1) and the center of the left eye cornea (2), and said third axis (z1) coincides with a first visual axis (V1), wherein said first visual axis (V1) is a straight line passing through the center of the right eye cornea (1) and said eye fixation point (P), a display reference system is associated with said display area (A), said display reference system being a three-dimensional Cartesian reference system having an origin (O) in the center of said display area (A) and comprising a first axis (x), a second axis (y), and a third axis (z), wherein said first axis (x) is horizontal and said third axis (z) is perpendicular to a display plane, wherein said display plane is a plane passing through said display area (A) arranged in such a way that said display area (A) belongs to said display plane,

    and/or

    for the left eye (2), a second position of the origin (O2) and a second orientation of said left eye reference system with respect to said display reference system, said left eye reference system being a three-dimensional Cartesian reference system, integral with the eyeball of said left eye (2), having an origin (O2) in the center of said left eye cornea (2) and comprising a first axis (x2), a second axis (y2) and a third axis (z2), wherein said second axis (y2) is orthogonal to said interpupillary axis (B) and said third axis (z2) coincides with a second visual axis (V2), wherein said second visual axis (V2) is a straight line passing through the center of said left eye cornea (2) and said eye fixation point (P);

    - a correction device (6) adapted to modify the video frames of a digital video stream on the basis of visual defects perceived due to a degenerative disease of the retina, in which are stored a first correction scheme or right correction scheme (SCDX) comprising one or more first digital filters (11) configured to change the value of one or more pixels of at least one first portion of video frame, wherein each first digital filter (11) is associated with at least one predetermined first portion of video frame, and/or a second correction scheme or left correction scheme (SCSX) comprising one or more second digital filters (12) configured to change the value of one or more pixels of at least one second portion of video frame, wherein each second digital filter (12) is associated with at least one predetermined portion of the second video frame, said right correction scheme (SCDX) being a first data structure comprising information relating to said one or more first digital filters (11), the information related to shape, size and position of at least one first portion of video frame at which at least one first visual defect is perceived by a person, and information on associations related to said first portions of video frame with each of said first digital filter (11); said right correction scheme (SCDX) having a graphic format so as to be displayed with a predetermined first image, wherein one or more portions of said predetermined first image are associated with a respective first digital filter (11) and each first digital filter (11) is associated with a respective predetermined first portion of video frame, said left correction scheme (SCSX) being a second data structure comprising information relating to said one or more second digital filters (12), the information related to shape, size and position of at least one second portion of video frame at which at least one second visual defect is perceived by a person, and information relating to the associations of said second portions of video frame with each of said second digital filters (12); said left correction scheme (SCSX) having a graphic format so as to be displayed with a predetermined second image, wherein one or more portions of said predetermined second image are associated with a respective second digital filter (12) and each second digital filter (12) is associated with a respective predetermined second portion of video frame;

    - a stereoscopic or autostereoscopic video system (7), wherein said stereoscopic or autostereoscopic video system (7) comprises a display device (71) provided with said display area (A),
    wherein
    said correction device (6) is connected to said first video source (SV1) and said second video source (SV2), as well as to said tracking system (5) and to said stereoscopic or autostereoscopic video system (7), and is configured for at least:

    ∘ acquiring said second digital video stream (FD2), wherein said second digital video stream comprises a succession of second video frames (FD21,FD22...FD2N);

    ∘ receiving from said tracking system
    with reference to said right eye (1), said first position of the origin (O1) and/or said first orientation of said right eye reference system, and/or
    with reference to said left eye (2), said second position of the origin (O2) and/or said second orientation of a left eye reference system;

    ∘ comparing
    with reference to said right eye (1), said first position of the origin (O1) of said right eye reference system with a predetermined first position of the origin (O1) to determine whether said first position of the origin (O1) is different from said predetermined first position, and/or said first orientation of said right eye reference system with a predetermined first orientation in order to verify if said first orientation is different from said predetermined first orientation, said predetermined first position of the origin (O1) and said predetermined first orientation are such that the following predetermined first conditions are met:

    • said eye fixation point (P) coincides with the center of said display area (A),

    • said right eye (1) is at a predetermined first distance (D1) from said display area (A), and

    • said first axis (x1) and said second axis (y1) of said right eye reference system are parallel respectively to said first axis (x) and said second axis (y) of said display reference system;

    and/or
    with reference to said left eye (2), said second position of the origin (O2) of said eye left reference system with a predetermined second position of the origin (O2) to determine whether said second position of the origin (O2) is different from said predetermined second position, and/or said second orientation of said left eye reference system with a predetermined second orientation in order to verify if said second orientation is different from said predetermined second orientation, said predetermined second position of the origin (O2) and said predetermined second orientation are such that the following predetermined second conditions are met:

    • said eye fixation point (P) coincides with the center of said display area (A),

    • said left eye (2) is at a predetermined second distance (D2) from said display area (A), and

    • said first axis (x2) and said second axis (y2) of said left eye reference system are parallel respectively to said first axis (x) and said second axis (y) of said display reference system;

    ∘ reconfiguring said right correction scheme (SCDX) on the basis of said first position of the origin (O1) and/or said first orientation, so that said one or more first digital filters (11) are applied to respective first portions of video frame, different from said predetermined first portions of video frame, when said first position of the origin (O1) of said right eye reference system is different from said predetermined first position of the origin (O1) and/or said first orientation of said right eye reference system is different from said predetermined first orientation, and/or reconfiguring said left correction scheme (SCSX) based on said second position of the origin (O2) and/or said second orientation, so that one or more second digital filters (12) are applied to one or more respective second portions of video frame, different from said predetermined second portions of video frame, when said second position of the origin (O2) of said left eye reference system is different from said predetermined second position of the origin (O2) and/or said second orientation is different from said predetermined second orientation;

    ∘ applying

    said right correction scheme (SCDX) to at least one second video frame (FD21,FD22...FD2N) of said second digital video stream (FD2) in such a way that said one or more first digital filters (11) are applied to at least one first portion of video frame, so as to obtain a third digital video stream or right digital stream (FD2DX) for the right eye (1), different from said second digital video stream (FD2), wherein said right digital stream (FD2DX) comprises at least one second modified video frame (FD21',FD22'...FD2N'), and/or
    said left correction scheme (SCSX) to at least one second video frame (FD21,FD22...FD2N) of said second digital video stream (FD2) in such a way that said one or more second digital filters (12) are applied to at least one second portion of video frame, so as to obtain a fourth digital video stream or left digital stream (FD2SX) for the left eye (2), different from said second digital video stream (FD2), wherein said left digital stream (FD2SX) comprises at least one further modified second video frame (FD21",FD22"...FD2N");

    ∘ generating a multiview digital video stream (MV) comprising a first sequence of video frames associated with said second digital video stream (FD2) or said right digital video stream (FD2DX), and a second sequence of video frames associated with said second digital video stream (FD2) or said left digital video stream (FD2SX);

    ∘ executing a video encoding compatible with said stereoscopic or autostereoscopic video system (7);
    said stereoscopic or autostereoscopic video system (7) is configured to:

    ∘ receive as input said multiview digital video stream (MV)

    ∘ display said multiview digital video stream (MV) in such a way that said first sequence of video frames of said multiview digital video stream (MV) be seen by said right eye (1) and said second succession of video frames of said multiview digital video stream (MV) be seen by said left eye (2).


     
    7. System according to the preceding claim, characterized in that said right correction scheme (SCDX) comprises a plurality of first digital filters (11), and said left correction scheme (SCSX) comprises a plurality of said second digital filters (12).
     
    8. System according to claim 6 or 7, characterized in that each first digital filter (11) is graphically represented in a respective portion of said predetermined first image of said right correction scheme (SCDX) and in that each second digital filter (12) is graphically represented in a respective further portion of said predetermined second image of said left correction scheme (SCSX).
     
    9. System according any one of claims 6 - 8, characterized in that said first video source (SV1) is said second video source (SV2).
     
    10. System according to any one of claims 6-9, characterized in that said visual content is an image or a television broadcast or a live video or a recorded video or a video output of a computer.
     


    Ansprüche

    1. Verfahren zum Modifizieren eines oder mehrerer Videoframes eines digitalen Videostreams, der auf einem Anzeigebereich (A) anzuzeigen ist,
    wobei

    - ein erstes Augenreferenzsystem oder rechtes Augenreferenzsystem dem rechten Auge (1) zugehörig ist, wobei das rechte Augenreferenzsystem ein dreidimensionales kartesisches Referenzsystem ist, ganzheitlich mit dem Augapfel des rechten Auges (1) ist und einen Ursprung (O1) im Mittelpunkt der Hornhaut des rechten Auges (1) aufweist und eine erste Achse (x1), eine zweite Achse (y1) und eine dritte Achse (z1) umfasst, wobei die zweite Achse (y1) orthogonal zu einer Pupillenachse (B) ist, wobei die Pupillenachse (B) eine gerade Linie ist, die durch den Mittelpunkt der Hornhaut des rechten Auges (1) und zum Mittelpunkt der Hornhaut des linken Auges (2) geht, und die dritte Achse (z1) mit einer ersten Sichtachse (V1) zusammenfällt, wobei die erste Sichtachse (V1) eine gerade Linie ist, die durch den Mittelpunkt der Hornhaut des rechten Auges (1) und einen Augenfixierpunkt (P) geht, wobei der Augenfixierpunkt (P) ein Punkt des Anzeigebereichs (A) ist, der von einer Person beobachtet wird, wobei der Anzeigebereich (A) Teil eines stereoskopischen oder autostereoskopischen Videosystems (7) ist,

    - ein zweites Augenreferenzsystem oder linkes Augenreferenzsystem dem linken Auge (2) zugehörig ist, wobei das linke Augenreferenzsystem ein dreidimensionales kartesisches Referenzsystem ist, ganzheitlich mit dem Augapfel des linken Auges (2) ist, einen Ursprung (O2) im Mittelpunkt der Hornhaut des linken Auges (2) aufweist und eine erste Achse (x2), eine zweite Achse (y2) und eine dritte Achse (z2) umfasst, wobei die zweite Achse (y2) orthogonal zu der Pupillenachse (B) ist und die dritte Achse (z2) mit einer zweiten Sichtachse (V2) zusammenfällt, wo die zweite Sichtachse (V2) eine gerade Linie ist, die durch den Mittelpunkt der Hornhaut des linken Auges (2) und den Augenfixierpunkt (P) geht,

    - ein Anzeigereferenzsystem dem Anzeigebereich (A) zugehörig ist, wobei das Anzeigereferenzsystem ein dreidimensionales kartesisches Referenzsystem ist, das einen Ursprung (O) im Mittelpunkt des Anzeigebereichs (A) aufweist und eine erste Achse (x), eine zweite Achse (y) und eine dritte Achse (z) umfasst, wobei die erste Achse (x) horizontal ist und die dritte Achse (z) senkrecht zu einer Anzeigeebene ist, wobei die Visualisierungsebene eine Ebene ist, die durch den Anzeigebereich geht und so angeordnet ist, dass der Anzeigebereich (A) zu der Anzeigeebene gehört,
    das Verfahren die folgenden Schritte umfasst:

    A) Beschaffen eines ersten digitalen Videostreams (FD1), wobei der erste digitale Videostream eine Abfolge erster Videoframes (FD11, FD12 ... FD1N) umfasst;

    B) Identifizieren in Bezug auf den ersten digitalen Videostream (FD1)
    für das rechte Auge (1) der Form, Größe und Position mindestens eines ersten Abschnitts vom Videoframe von mindestens einem ersten Videoframe (FD11, FD12 ... FD1N) in Übereinstimmung damit, welcher zumindest eine erste visuelle Defekt von der Person wahrgenommen wird, wobei Form, Größe und Position des mindestens einen ersten Abschnitts vom Videoframe ermittelt werden, wenn das rechte Augenreferenzsystem den Ursprung (O1) in einer vorgegebenen ersten Position und einer vorgegebenen ersten Ausrichtung aufweist, sodass die folgenden vorgegebenen ersten Bedingungen erfüllt sind:

    der Augenfixierpunkt (P) fällt mit dem Mittelpunkt des Anzeigebereichs (A) zusammen,

    das rechte Auge (1) ist bei einem vorgegebenen ersten Abstand (D1) vom Anzeigebereich (A), und

    die erste Achse (x1) und die zweite Achse (y1) des rechten Augenreferenzsystems sind parallel zu der ersten Achse (x) beziehungsweise der zweiten Achse (y) des Anzeigereferenzsystems; und/oder

    für das linke Auge (2) der Form, Größe und Position von mindestens einem zweiten Abschnitt vom Videoframe von mindestens einem ersten Videoframe (FD11, FD12 ... FD1N) in Übereinstimmung damit, welcher mindestens eine zweite visuelle Defekt von der Person wahrgenommen wird, wo Form, Größe und Position des mindestens einen zweiten Abschnitts vom Videoframe ermittelt werden, wenn das linke Augenreferenzsystem den Ursprung (O2) in einer vorgegebenen zweiten Position und einer vorgegebenen zweiten Ausrichtung aufweist, sodass die folgenden vorgegebenen zweiten Bedingungen erfüllt sind:

    der Augenfixierpunkt (P) fällt mit dem Mittelpunkt des Anzeigebereichs (A) zusammen,

    das linke Auge (2) ist bei einem vorgegebenen zweiten Abstand (D2) vom Anzeigebereich (A), und

    die erste Achse (x2) und die zweite Achse (y2) des linken Augenreferenzsystems sind parallel zur ersten Achse (x) beziehungsweise der zweiten Achse (y) des Anzeigereferenzsystems;

    C) Ermitteln
    für den mindestens einen ersten Abschnitt vom Videoframe des mindestens einen ersten Videoframes (FD11, FD12 ... FD1N) eines oder mehrerer erster digitaler Filter (11), die konfiguriert sind, den Wert eines oder mehrerer Pixel des mindestens einen ersten Abschnitts vom Videoframe zu ändern, von denen jedes einem jeweiligen vorgegebenen ersten Abschnitt vom Videoframe zugehörig ist, und/oder
    für den mindestens einen zweiten Abschnitt vom Videoframe des mindestens einen ersten Videoframes (FD11, FD12 ... FD1N) eines oder mehrerer zweiter digitaler Filter (12), die konfiguriert sind, den Wert eines oder mehrerer Pixel des mindestens einen zweiten Abschnitts vom Videoframe zu ändern, von denen jedes einem jeweiligen vorgegebenen zweiten Abschnitt vom Videoframe zugehörig ist;

    D) Konfigurieren
    für das rechte Auge (1), eines ersten Korrekturschemas oder rechten Korrekturschemas (SCDX), das das eine oder die mehreren ersten digitalen Filter (11) umfasst, wobei das rechte Korrekturschema (SCDX) eine erste Datenstruktur ist, die konfiguriert ist, den mindestens einen ersten Abschnitt vom Videoframe zu modifizieren, wobei die erste Datenstruktur Informationen bezüglich des einen oder der mehreren ersten digitalen Filter (11), die Informationen bezüglich Form, Größe und Position jedes der ersten Abschnitte vom Videoframe und Informationen bezüglich der Zugehörigkeiten der ersten Abschnitte vom Videoframe zu jedem der ersten digitalen Filter (11) umfasst; das rechte Korrekturschema (SCDX) ein Grafikformat aufweist, um mit einem vorgegebenen ersten Bild angezeigt zu werden, wobei ein oder mehrere Abschnitte des vorgegebenen ersten Bilds einem jeweiligen ersten digitalen Filter (11) zugehörig sind und jedes erste digitale Filter (11) einem jeweiligen vorgegebenen ersten Abschnitt vom Videoframe zugehörig ist,
    und/oder
    für das linke Auge (2), eines zweiten Korrekturschemas oder linken Korrekturschemas (SCSX), das ein oder mehrere zweite digitale Filter (12) umfasst, wobei das linke Korrekturschema (SCSX) eine zweite Datenstruktur ist, die konfiguriert ist, den mindestens einen zweiten Abschnitt vom Videoframe zu modifizieren, wobei die zweite Datenstruktur Informationen bezüglich des einen oder der mehreren zweiten digitalen Filter (12), die Informationen bezüglich der Form, Größe und Position jedes der zweiten Abschnitte vom Videoframe und Informationen bezüglich Zugehörigkeiten der zweiten Abschnitte vom Videoframe zu jedem der zweiten digitalen Filter (12) umfasst; das linke Korrekturschema (SCSX) ein Grafikformat aufweist, um mit einem vorgegebenen zweiten Bild angezeigt zu werden, wobei ein oder mehrere Abschnitte des vorgegebenen zweiten Bilds einem jeweiligen zweiten digitalen Filter (12) zugehörig sind und jedes zweite digitale Filter (12) einem jeweiligen vorgegebenen zweiten Abschnitt vom Videoframe zugehörig ist;

    E) Beschaffen eines zweiten digitalen Videostreams (FD2), wobei der zweite digitale Videostream (FD2) eine Abfolge zweiter Videoframes (FD21, FD22 ... FD2N) umfasst, wobei die zweiten Videoframes (FD21, FD22 ... FD2N) des zweiten digitalen Streams (FD2) Videoframes sind, die sich auf einen visuellen Inhalt beziehen, der auf dem Anzeigebereich (A) angezeigt werden kann;

    F) Berechnen
    für das rechte Auge (1), einer ersten Position des Ursprungs (O1) und einer ersten Ausrichtung des rechten Augenreferenzsystems in Bezug auf das Anzeigereferenzsystem, und/oder
    für das linke Auge (2), einer zweiten Position des Ursprungs (O2) und einer zweiten Ausrichtung des linken Augenreferenzsystems in Bezug auf das Anzeigereferenzsystem;

    G) Vergleichen
    in Bezug auf das rechte Auge (1), der ersten Position des Ursprungs (O1) des rechten Augenreferenzsystems mit der vorgegebenen ersten Position des Ursprungs (O1) in den vorgegebenen ersten Bedingungen, um zu verifizieren, ob die erste Position des Ursprungs (O1) sich von der vorgegebenen ersten Position unterscheidet und/oder die erste Ausrichtung des rechten Augenreferenzsystems mit der vorgegebenen ersten Ausrichtung in den vorgegebenen ersten Bedingungen, um zu verifizieren, ob die erste Ausrichtung sich von der vorgegebenen ersten Ausrichtung unterscheidet, und/oder
    in Bezug auf das linke Auge (2), der zweiten Position des Ursprungs (O2) des linken Augenreferenzsystems mit der vorgegebenen zweiten Position des Ursprungs (O2) in den vorgegebenen zweiten Bedingungen, um zu verifizieren, ob die zweite Position des Ursprungs (O2) sich von der vorgegebenen zweiten Position unterscheidet, und/oder der zweiten Ausrichtung des linken Augenreferenzsystems mit der vorgegebenen zweiten Ausrichtung in den vorgegebenen zweiten Bedingungen, um zu verifizieren, ob die zweite Ausrichtung sich von der vorgegebenen zweiten Ausrichtung unterscheidet;

    H) wenn die erste Position des Ursprungs (O1) des rechten Augenreferenzsystems sich von der vorgegebenen ersten Position des Ursprungs (O1) unterscheidet und/oder die erste Ausrichtung des rechten Augenreferenzsystems sich von der vorgegebenen ersten Ausrichtung unterscheidet, Rekonfigurieren des rechten Korrekturschemas (SCDX) auf der Basis der ersten Position des Ursprungs (O1) und/oder der ersten Ausrichtung, sodass das eine oder die mehreren ersten digitalen Filter (11) auf jeweilige erste Abschnitte vom Videoframe angewendet werden, die sich von den vorgegebenen ersten Abschnitten vom Videoframe unterscheiden, und/oder
    wenn die zweite Position des Ursprungs (O2) des linken Augenreferenzsystems sich von der vorgegebenen zweiten Position des Ursprungs (O2) unterscheidet und/oder die zweite Ausrichtung sich von der vorgegebenen zweiten Ausrichtung unterscheidet, Rekonfigurieren des linken Korrekturschemas (SCSX), basierend auf der zweiten Position des Ursprungs (O2) und/oder der zweiten Ausrichtung, sodass ein oder mehrere zweite digitale Filter (12) auf einen oder mehrere jeweilige zweite Abschnitte vom Videoframe angewendet werden, die sich von den vorgegebenen zweiten Abschnitten vom Videoframe unterscheiden;

    I) Anwenden
    des rechten Korrekturschemas (SCDX) auf mindestens ein zweites Videoframe (FD21, FD22 ... FD2N) des zweiten digitalen Videostreams (FD2) so, dass ein oder mehrere erste digitale Filter (11) auf mindestens einen ersten Abschnitt vom Videoframe angewendet werden, um einen dritten digitalen Videostream oder rechten digitalen Stream (FD2DX) für das rechte Auge (1) zu erhalten, der sich von dem zweiten digitalen Videostream (FD2) unterscheidet, wobei der rechte digitale Stream (FD2DX) mindestens ein zweites modifiziertes Videoframe (FD21', FD22' ... FD2N') umfasst, und/oder
    das linke Korrekturschema (SCSX) auf mindestens ein zweites Videoframe (FD21, FD22 ... FD2N) des zweiten digitalen Videostreams (FD2) so, dass das eine oder die mehreren zweiten digitalen Filter (12) auf mindestens einen zweiten Abschnitt vom Videoframe angewendet werden, um einen vierten digitalen Videostream oder linken digitalen Stream (FD2SX) für das linke Auge (2) zu erhalten, der sich von dem zweiten digitalen Videostream (FD2) unterscheidet, wobei der linke digitale Stream (FD2SX) mindestens ein weiteres zweites modifiziertes Videoframe (FD21', FD22' ... FD2N') umfasst;

    L) Erzeugen eines digitalen Multiview-Videostreams (MV), der eine erste Abfolge von Videoframes umfasst, die dem zweiten digitalen Videostream (FD2) oder dem rechten digitalen Videostream (FD2DX) zugehörig sind, und eine zweite Abfolge von Videoframes, die dem zweiten digitalen Videostream (FD2) oder dem linken digitalen Videostream (FD2SX) zugehörig sind;

    M) Anzeigen des digitalen Multiview-Videostreams (MV) durch das stereoskopische oder autostereoskopische Videosystem (7) so, dass die erste Abfolge von Videoframes des digitalen Multiview-Videostreams (MV) vom rechten Auge (1) gesehen wird und die zweite Abfolge von Videoframes des digitalen Multiview-Videostreams (MV) vom linken Auge (2) gesehen wird.


     
    2. Verfahren nach dem vorstehenden Anspruch, dadurch gekennzeichnet, dass, falls das rechte Auge (1) und/oder das linke Auge (2) sich bewegen und/oder der Kopf der Person sich bewegt, das Verfahren weiter die folgenden Schritte umfasst:

    F') Berechnen
    für das rechte Auge (1), einer weiteren ersten Position des Ursprungs (O1) und einer weiteren ersten Ausrichtung des rechten Augenreferenzsystems in Bezug auf das Anzeigereferenzsystem, und/oder
    für das linke Auge (2), einer weiteren zweiten Position des Ursprungs (O2) und einer weiteren zweiten Ausrichtung des linken Augenreferenzsystems in Bezug auf das Anzeigereferenzsystem;

    G1) Vergleichen
    der weiteren ersten Position des Ursprungs (O1) des rechten Augenreferenzsystems mit der vorgegebenen ersten Position des Ursprungs (O1) in den vorgegebenen ersten Bedingungen, um zu verifizieren, ob die weitere erste Position des Ursprungs (O1) des rechten Augenreferenzsystems sich von der vorgegebenen ersten Position unterscheidet und/oder der weiteren ersten Ausrichtung des rechten Augenreferenzsystems mit der vorgegebenen ersten Ausrichtung in den vorgegebenen ersten Bedingungen, um zu verifizieren, ob die weitere erste Ausrichtung sich von der vorgegebenen ersten Ausrichtung unterscheidet, und/oder
    der weiteren zweiten Position des Ursprungs (O2) des linken Augenreferenzsystems mit der vorgegebenen zweiten Position des Ursprungs (O2) in den vorgegebenen zweiten Bedingungen, um zu verifizieren, ob die weitere zweite Position des Ursprungs (O2) sich von der vorgegebenen zweiten Position unterscheidet und/oder der weiteren zweiten Ausrichtung des linken Augenreferenzsystems mit der vorgegebenen zweiten Ausrichtung in den vorgegebenen zweiten Bedingungen, um zu verifizieren, ob die weitere zweite Ausrichtung sich von der vorgegebenen zweiten Ausrichtung unterscheidet;

    G2) für das rechte Auge (1), Vergleichen
    der weiteren ersten Position des Ursprungs (O1) des rechten Augenreferenzsystems mit der ersten Position, um zu verifizieren, ob die weitere erste Position des Ursprungs (O1) sich von der ersten Position des Ursprungs (O1) unterscheidet, wenn die weitere erste Position des Ursprungs (O1) des rechten Augenreferenzsystems sich von der vorgegebenen ersten Position des Ursprungs (O1) in den vorgegebenen ersten Bedingungen unterscheidet, und/oder der weiteren ersten Ausrichtung des rechten Augenreferenzsystems mit der ersten Ausrichtung, um zu verifizieren, ob die weitere erste Ausrichtung sich von der ersten Ausrichtung unterscheidet, wenn die weitere erste Ausrichtung des rechten Augenreferenzsystems sich von der vorgegebenen ersten Ausrichtung in den vorgegebenen ersten Bedingungen unterscheidet,
    und/oder
    für das linke Auge (2), Vergleichen
    der weiteren zweiten Position des Ursprungs (O2) des linken Augenreferenzsystems mit der zweiten Position des Ursprungs (O2), um zu ermitteln, ob die weitere zweite Position des Ursprungs (O2) sich von der zweiten Position des Ursprungs (O2) unterscheidet, wenn die weitere zweite Position des Ursprungs (O2) des linken Augenreferenzsystems sich von der vorgegebenen zweiten Position des Ursprungs (O2) in den vorgegebenen zweiten Bedingungen unterscheidet und/oder der weiteren zweiten Ausrichtung des linken Augenreferenzsystems mit der zweiten Ausrichtung, um zu verifizieren, ob die weitere zweite Ausrichtung sich von der zweiten Ausrichtung unterscheidet, wenn die weitere zweite Ausrichtung des linken Augenreferenzsystems sich von der vorgegebenen zweiten Ausrichtung in den vorgegebenen zweiten Bedingungen unterscheidet;

    H') Neukonfigurieren des rechten Korrekturschemas (SCDX) basierend auf der weiteren ersten Position des Ursprungs (O1) wie berechnet, wenn die weitere erste Position des Ursprungs (O1) des rechten Augenreferenzsystems sich von der ersten Position des Ursprungs (O1) unterscheidet und/oder auf der Basis der weiteren ersten Ausrichtung wie berechnet, wenn die weitere erste Ausrichtung sich von der ersten Ausrichtung unterscheidet und/oder
    Neukonfigurieren des linken Korrekturschemas (SCSX) basierend auf der weiteren zweiten Position des Ursprungs (O2) wie berechnet, wenn die weitere zweite Position des Ursprungs (O2) des linken Augenreferenzsystems sich von der zweiten Position des Ursprungs (O2) unterscheidet und/oder auf der Basis der weiteren zweiten Ausrichtung wie berechnet, wenn die weitere zweite Ausrichtung sich von der zweiten Ausrichtung unterscheidet.


     
    3. Verfahren nach einem der vorstehenden Ansprüche, dadurch gekennzeichnet, dass jedes der ersten Videoframes ein Amsler-Gitter ist.
     
    4. Verfahren nach einem der vorstehenden Ansprüche, dadurch gekennzeichnet, dass jedes erste digitale Filter (11) grafisch in einem jeweiligen Abschnitt des vorgegebenen ersten Bilds des rechten Korrekturschemas (SCDX) dargestellt ist und dadurch, dass jedes zweite digitale Filter (12) grafisch in einem jeweiligen weiteren Abschnitt des vorgegebenen zweiten Bilds des linken Korrekturschemas (SCSX) dargestellt ist.
     
    5. Verfahren nach einem der vorstehenden Ansprüche, dadurch gekennzeichnet, dass der visuelle Inhalt des zweiten digitalen Videostreams (FD2) ein Bild oder ein Fernsehsignal oder ein Live-Video oder ein aufgezeichnetes Video oder ein Videoausgang eines Computers ist.
     
    6. System zum Modifizieren eines oder mehrerer Videoframes eines digitalen Videostreams, der auf einem Anzeigebereich (A) angezeigt werden kann, das System umfassend:

    - eine erste digitale Videoquelle (SV1), die konfiguriert ist, einen ersten digitalen Videostream (FD1) bereitzustellen, wobei der erste digitale Videostream (FD1) eine Abfolge erster Videoframes (FD11, FD12 ... FD1N) umfasst; wobei das eine oder die mehreren ersten digitalen Filter (11) und/oder das eine oder die mehreren zweiten digitalen Filter (12) in Bezug auf den ersten digitalen Videostream (FD1) ermittelt sind,

    - eine zweite Videoquelle (SV2), die konfiguriert ist, einen zweiten digitalen Videostream (FD2) bereitzustellen, wobei der zweite digitale Videostream (FD2) eine Abfolge zweiter Videoframes (FD21, FD22 ... FD2N) umfasst; wobei die zweiten Videoframes (FD21, FD22 ... FD2N) des zweiten digitalen Streams (FD2) sich auf einen visuellen Inhalt beziehen, der auf dem Anzeigebereich (A) angezeigt werden kann;

    - ein Verfolgungssystem (5) zum Verfolgen eines Augenfixierpunkts (P) in dem Anzeigebereich (A), mindestens konfiguriert zum Berechnen:

    für das rechte Auge (1), einer ersten Position des Ursprungs (O1) und einer ersten Ausrichtung eines rechten Augenreferenzsystems in Bezug auf ein Anzeigereferenzsystem, wobei das rechte Augenreferenzsystem ein dreidimensionales kartesisches Referenzsystem ist, ganzheitlich mit dem Augapfel des rechten Auges (1) ist, einen Ursprung (O1) im Mittelpunkt der Hornhaut des rechten Auges (1) aufweist und eine erste Achse (x1), eine zweite Achse (y1) und eine dritte Achse (z1) umfasst, wobei die zweite Achse (y1) orthogonal zu einer Pupillenachse (B) ist, wobei die Pupillenachse (B) eine gerade Linie ist, die durch den Mittelpunkt der Hornhaut des rechten Auges (1) und den Mittelpunkt der Hornhaut des linken Auges (2) geht, und die dritte Achse (z1) mit einer ersten Sichtachse (V1) zusammenfällt, wobei die erste Sichtachse (V1) eine gerade Linie ist, die durch den Mittelpunkt der Hornhaut des rechten Auges (1) und den Augenfixierpunkt (P) geht, ein Anzeigereferenzsystem dem Anzeigebereich (A) zugehörig ist, wobei das Anzeigereferenzsystem ein dreidimensionales kartesisches System ist, das einen Ursprung (O) im Mittelpunkt des Anzeigebereichs (A) aufweist und eine erste Achse (x), eine zweite Achse (y) und eine dritte Achse (z) umfasst, wobei die erste Achse (x) horizontal ist und die dritte Achse (z) senkrecht zu einer Anzeigeebene ist, wobei die Visualisierungsebene eine Ebene ist, die durch den Anzeigebereich geht und so angeordnet ist, dass der Anzeigebereich (A) zu der Anzeigeebene gehört,

    und/oder

    für das linke Auge (2), einer zweiten Position des Ursprungs (O2) und einer zweiten Ausrichtung des linken Augenreferenzsystems in Bezug auf das Anzeigereferenzsystem, wobei das linke Augenreferenzsystem ein dreidimensionales kartesisches Referenzsystem ist, ganzheitlich mit dem Augapfel des linken Auges (2) ist, einen Ursprung (O2) im Mittelpunkt der Hornhaut des linken Auges (2) aufweist und eine erste Achse (x2), eine zweite Achse (y2) und eine dritte Achse (z2) umfasst, wobei die zweite Achse (y2) orthogonal zu der Pupillenachse (B) ist und die dritte Achse (z2) mit einer zweiten Sichtachse (V2) zusammenfällt, wobei die zweite Sichtachse (V2) eine gerade Linie ist, die durch den Mittelpunkt der Hornhaut des linken Auges (2) und den Augenfixierpunkt (P) geht;

    - eine Korrekturvorrichtung (6), die angepasst ist, die Videoframes eines digitalen Videostreams auf der Basis visueller Defekte zu modifizieren, die aufgrund einer degenerativen Erkrankung der Netzhaut wahrgenommen werden, in der ein erstes Korrekturschema oder rechtes Korrekturschema (SCDX), das ein oder mehrere erste digitale Filter (11) umfasst, die konfiguriert sind, den Wert eines oder mehrerer Pixel mindestens eines ersten Abschnitts vom Videoframe zu ändern, wobei jedes erste digitale Filter (11) mindestens einem vorgegebenen ersten Abschnitt vom Videoframe zugehörig ist, und/oder ein zweites Korrekturschema oder linkes Korrekturschema (SCSX), das ein oder mehrere zweite digitale Filter (12) umfasst, die konfiguriert sind, den Wert eines oder mehrerer Pixel mindestens eines zweiten Abschnitts vom Videoframe zu ändern, wobei jedes zweite digitale Filter (12) mindestens einem vorgegebenen Abschnitt des zweiten Videoframes zugehörig ist, gespeichert sind, wobei das rechte Korrekturschema (SCDX) eine erste Datenstruktur ist, die Informationen bezüglich des einen oder der mehreren ersten digitalen Filter (11), die Informationen bezüglich Form, Größe und Position von mindestens einem ersten Abschnitt vom Videoframe, bei dem mindestens ein erster visueller Defekt von einer Person wahrgenommen wird, und Informationen über Zugehörigkeiten bezüglich der ersten Abschnitte vom Videoframe mit jedem des ersten digitalen Filters (11) umfasst; das rechte Korrekturschema (SCDX), das ein Grafikformat aufweist, um mit einem vorgegebenen ersten Bild angezeigt zu werden, wobei ein oder mehrere Abschnitte des vorgegebenen ersten Bilds einem jeweiligen ersten digitalen Filter (11) zugehörig sind und jedes erste digitale Filter (11) einem jeweiligen vorgegebenen ersten Abschnitt vom Videoframe zugehörig ist, das linke Korrekturschema (SCSX) eine zweite Datenstruktur ist, die Informationen bezüglich des einen oder der mehreren zweiten digitalen Filter (12), die Informationen bezüglich Form, Größe und Position von mindestens einem zweiten Abschnitts vom Videoframe, bei dem mindestens ein zweiter visueller Defekt von einer Person wahrgenommen wird, und Informationen bezüglich der Zugehörigkeiten der zweiten Abschnitte vom Videoframe mit jedem der zweiten digitalen Filter (12) umfasst; das linke Korrekturschema (SCSX) ein Grafikformat aufweist, um mit einem vorgegebenen zweiten Bild angezeigt zu werden, wobei ein oder mehrere Abschnitte des vorgegebenen zweiten Bilds einem jeweiligen zweiten digitalen Filter (12) zugehörig sind und jedes zweite digitale Filter (12) einem jeweiligen vorgegebenen zweiten Abschnitt vom Videoframe zugehörig ist;

    - ein stereoskopisches oder autostereoskopisches Videosystem (7), wobei das stereoskopische oder autostereoskopische Videosystem (7) eine Anzeigevorrichtung (71) umfasst, die mit dem Anzeigebereich (A) bereitgestellt ist,
    wobei
    die Korrekturvorrichtung (6) mit der ersten Videoquelle (SV1) und der zweiten Videoquelle (SV2) verbunden ist, wie auch mit dem Verfolgungssystem (5) und dem stereoskopischen oder autostereoskopischen Videosystem (7) und mindestens konfiguriert ist zum:

    ∘ Beschaffen des zweiten digitalen Videostreams (FD2), wobei der zweite digitale Videostream eine Abfolge von zweiten Videoframes (FD21, FD22 ... FD2N) umfasst;

    ∘ Empfangen vom Verfolgungssystem
    in Bezug auf das rechte Auge (1), der ersten Position des Ursprungs (O1) und/oder der ersten Ausrichtung des rechten Augenreferenzsystems, und/oder
    in Bezug auf das linke Auge (2), der zweiten Position des Ursprungs (O2) und/oder der zweiten Ausrichtung eines linken Augenreferenzsystems;

    ∘ Vergleichen
    in Bezug auf das rechte Auge (1), der ersten Position des Ursprungs (O1) des rechten Augenreferenzsystems mit einer vorgegebenen ersten Position des Ursprungs (O1), um zu ermitteln, ob die erste Position des Ursprungs (O1) sich von der vorgegebenen ersten Position unterscheidet und/oder der ersten Ausrichtung des rechten Augenreferenzsystems mit einer vorgegebenen ersten Ausrichtung, um zu verifizieren, ob die erste Ausrichtung sich von der vorgegebenen ersten Ausrichtung unterscheidet, wobei die vorgegebene erste Position des Ursprungs (O1) und die vorgegebene erste Ausrichtung so sind, dass die folgenden vorgegebenen ersten Bedingungen erfüllt sind:

    ∘ der Augenfixierpunkt (P) fällt mit dem Mittelpunkt des Anzeigebereichs (A) zusammen,

    ∘ das rechte Auge (1) ist bei einem vorgegebenen ersten Abstand (D1) vom Anzeigebereich (A), und

    ∘ die erste Achse (x1) und die zweite Achse (y1) des rechten Augenreferenzsystems sind parallel zu der ersten Achse (x) beziehungsweise der zweiten Achse (y) des Anzeigereferenzsystems;

    und/oder
    in Bezug auf das linke Auge (2), der zweiten Position des Ursprungs (O2) des linken Augenreferenzsystems mit einer vorgegebenen zweiten Position des Ursprungs (O2), um zu ermitteln, ob die zweite Position des Ursprungs (O2) sich von der vorgegebenen zweiten Position unterscheidet und/oder der zweiten Ausrichtung des linken Augenreferenzsystems mit einer vorgegebenen zweiten Ausrichtung, um zu verifizieren, ob die zweite Ausrichtung sich von der vorgegebenen zweiten Ausrichtung unterscheidet, wobei die vorgegebene zweite Position des Ursprungs (O2) und die vorgegebene zweite Ausrichtung so sind, dass die folgenden vorgegebenen zweiten Bedingungen erfüllt sind:

    ∘ der Augenfixierpunkt (P) fällt mit dem Mittelpunkt des Anzeigebereichs (A) zusammen,

    ∘ das linke Auge (2) ist bei einem vorgegebenen zweiten Abstand (D2) vom Anzeigebereich (A), und

    ∘ die erste Achse (x2) und die zweite Achse (y2) des linken Augenreferenzsystems sind parallel zu der ersten Achse (x) beziehungsweise der zweiten Achse (y) des Anzeigereferenzsystems;

    ∘ Neukonfigurieren des rechten Korrekturschemas (SCDX) auf der Basis der ersten Position des Ursprungs (O1) und/oder der ersten Ausrichtung, sodass das eine oder die mehreren ersten digitalen Filter (11) auf jeweilige erste Abschnitte vom Videoframe angewendet werden, die sich von den vorgegebenen ersten Abschnitten vom Videoframe unterscheiden, wenn die erste Position des Ursprungs (O1) des rechten Augenreferenzsystems sich von der vorgegebenen ersten Position des Ursprungs (O1) unterscheidet und/oder die erste Ausrichtung des rechten Augenreferenzsystems sich von der vorgegebenen ersten Ausrichtung unterscheidet, und/oder Neukonfigurieren des linken Korrekturschemas (SCSX) basierend auf der zweiten Position des Ursprungs (O2) und/oder der zweiten Ausrichtung, sodass ein oder mehrere zweite digitale Filter (12) auf einen oder mehrere jeweilige zweite Abschnitte vom Videoframe angewendet werden, die sich von den vorgegebenen zweiten Abschnitten vom Videoframe unterscheiden, wenn die zweite Position des Ursprungs (O2) des linken Augenreferenzsystems sich von der vorgegebenen zweiten Position des Ursprungs (O2) unterscheidet und/oder die zweite Ausrichtung sich von der vorgegebenen zweiten Ausrichtung unterscheidet;

    ∘ Anwenden
    des rechten Korrekturschemas (SCDX) auf mindestens ein zweites Videoframe (FD21, FD22 ... FD2N) des zweiten digitalen Videostreams (FD2) so, dass das eine oder die mehreren ersten digitalen Filter (11) auf mindestens einen ersten Abschnitt vom Videoframe angewendet werden, um einen dritten digitalen Videostream oder rechten digitalen Stream (FD2DX) für das rechte Auge (1) zu erhalten, der sich von dem zweiten digitalen Videostream (FD2) unterscheidet, wobei der rechte digitale Stream (FD2DX) mindestens ein zweites modifiziertes Videoframe (FD21', FD22' ... FD2N') umfasst, und/oder
    das linke Korrekturschema (SCSX) auf mindestens ein zweites Videoframe (FD21, FD22 ... FD2N) des zweiten digitalen Videostreams (FD2) so, dass das eine oder die mehreren zweiten digitalen Filter (12) auf mindestens einen zweiten Abschnitt vom Videoframe angewendet werden, um einen vierten digitalen Videostream oder linken digitalen Stream (FD2SX) für das linke Auge (2) zu erhalten, der sich vom zweiten digitalen Videostream (FD2) unterscheidet, wobei der linke digitale Stream (FD2SX) mindestens ein weiteres modifiziertes zweites Videoframe (FD21", FD22" ... FD2N") umfasst;

    ∘ Erzeugen eines digitalen Multiview-Videostreams (MV), der eine erste Abfolge von Videoframes umfasst, die dem zweiten digitalen Videostream (FD2) oder dem rechten digitalen Videostream (FD2DX) zugehörig sind, und eine zweite Abfolge von Videoframes, die dem zweiten digitalen Videostream (FD2) oder dem linken digitalen Videostream (FD2SX) zugehörig sind;

    ∘ Ausführen einer Videocodierung, die mit dem stereoskopischen oder autostereoskopischen Videosystem (7) kompatibel ist;
    wobei das stereoskopische oder autostereoskopische Videosystem (7) konfiguriert ist zum:

    ∘ Empfangen als Eingang des digitalen Multiview-Videostreams (MV)

    ∘ Anzeigen des digitalen Multiview-Videostreams (MV) so, dass die erste Abfolge von Videoframes des digitalen Multiview-Videostreams (MV) vom rechten Auge (1) gesehen wird und die zweite Abfolge von Videoframes des digitalen Multiview-Videostreams (MV) vom linken Auge (2) gesehen wird.


     
    7. System nach dem vorstehenden Anspruch, dadurch gekennzeichnet, dass das rechte Korrekturschema (SCDX) eine Vielzahl von ersten digitalen Filtern (11) umfasst und das linke Korrekturschema (SCSX) eine Vielzahl der zweiten digitalen Filter (12) umfasst.
     
    8. System nach Anspruch 6 oder 7, dadurch gekennzeichnet, dass jedes erste digitale Filter (11) grafisch in einem jeweiligen Abschnitt des vorgegebenen ersten Bilds des rechten Korrekturschemas (SCDX) dargestellt ist, und dadurch, dass jedes zweite digitale Filter (12) grafisch in einem jeweiligen weiteren Abschnitt des vorgegebenen zweiten Bilds des linken Korrekturschemas (SCSX) dargestellt ist.
     
    9. System nach einem der Ansprüche 6-8, dadurch gekennzeichnet, dass die erste Videoquelle (SV1) die zweite Videoquelle (SV2) ist.
     
    10. System nach einem der Ansprüche 6-9, dadurch gekennzeichnet, dass der visuelle Inhalt ein Bild oder ein Fernsehsignal oder ein Live-Video oder ein aufgezeichnetes Video oder ein Videoausgang eines Computers ist.
     


    Revendications

    1. Procédé pour modifier une ou plusieurs trames vidéo d'un flux vidéo numérique à afficher sur une zone d'affichage (A),
    dans lequel

    - un premier système de référence oculaire ou système de référence oculaire droit est associé à l'œil droit (1), ledit système de référence oculaire droit étant un système de référence cartésien tridimensionnel, solidaire du globe oculaire dudit œil droit (1), et a une origine (O1) au centre de la cornée dudit œil droit (1) et comprend un premier axe (x1), un deuxième axe (y1) et un troisième axe (z1), dans lequel ledit deuxième axe (y1) est orthogonal à un axe interpupillaire (B), dans lequel ledit axe interpupillaire (B) est une ligne droite passant par le centre de la cornée de l'œil droit (1) et vers le centre de la cornée de l'œil gauche (2), et ledit troisième axe (z1) coïncide avec un premier axe visuel (V1), dans lequel ledit premier axe visuel (V1) est une ligne droite passant par le centre de la cornée de l'œil droit (1) et un point de fixation oculaire (P), dans lequel ledit point de fixation de l'œil (P) est un point de ladite zone d'affichage (A) observé par une personne, ladite zone d'affichage (A) faisant partie d'un système vidéo stéréoscopique ou autostéréoscopique (7),

    - un deuxième système de référence oculaire ou système de référence oculaire gauche est associé à l'œil gauche (2), ledit système de référence oculaire gauche étant un système de référence cartésien tridimensionnel, solidaire du globe oculaire dudit œil gauche (2), ayant une origine (O2) au centre de ladite cornée de l'œil gauche (2) et comprenant un premier axe (x2), un deuxième axe (y2) et un troisième axe (z2), dans lequel ledit deuxième axe (y2) est orthogonal audit axe interpupillaire (B) et ledit troisième axe (z2) coïncide avec un deuxième axe visuel (V2), où ledit deuxième axe visuel (V2) est une ligne droite passant par le centre de ladite cornée de l'œil gauche (2) et dudit point de fixation de l'œil (P),

    - un système de référence d'affichage est associé à ladite zone d'affichage (A), ledit système de référence d'affichage étant un système de référence cartésien tridimensionnel ayant une origine (O) au centre de ladite zone d'affichage (A) et comprenant un premier axe (x), un deuxième axe (y) et un troisième axe (z), dans lequel ledit premier axe (x) est horizontal et ledit troisième axe (z) est perpendiculaire à un plan d'affichage, dans lequel ledit plan de visualisation est un plan passant par ladite zone d'affichage et agencé de sorte que ladite zone d'affichage (A) appartient audit plan d'affichage,
    ledit procédé comprenant les étapes suivantes consistant à :

    A) acquérir un premier flux vidéo numérique (FD1), dans lequel ledit premier flux vidéo numérique comprend une succession de premières trames vidéo (FD11,FD12...FD1N) ;

    B) identifier par rapport audit premier flux vidéo numérique (FD1) pour l'œil droit (1) la forme, la taille et la position d'au moins une première partie de trame vidéo d'au moins une première trame vidéo (FD11,FD12...FD1N) en correspondance de laquelle au moins un premier défaut visuel est perçu par ladite personne, dans lequel la forme, la taille et la position de ladite au moins une première partie de trame vidéo sont déterminées lorsque ledit système de référence oculaire droit a l'origine (O1) dans un une première position prédéterminée et une première orientation prédéterminée de sorte que les premières conditions prédéterminées suivantes sont satisfaites :

    ledit point de fixation oculaire (P) coïncide avec le centre de ladite zone d'affichage (A),

    ledit œil droit (1) est à une première distance prédéterminée (D1) de ladite zone d'affichage (A), et

    ledit premier axe (x1) et ledit deuxième axe (y1) dudit système de référence oculaire droit sont parallèles respectivement audit premier axe (x) et audit deuxième axe (y) dudit système de référence d'affichage ;

    et/ou

    pour l'œil gauche (2) la forme, la taille et la position d'au moins une première partie de trame vidéo d'au moins une deuxième trame vidéo (FD11,FD12...FD1N) en correspondance de laquelle au moins un deuxième défaut visuel est perçu par ladite personne, où la forme, la taille et la position de ladite au moins une deuxième partie de trame vidéo sont déterminées lorsque ledit système de référence oculaire gauche a l'origine (O2) dans une deuxième position prédéterminée et une deuxième orientation prédéterminée de sorte que les deuxièmes conditions prédéterminées suivantes sont satisfaites :

    ledit point de fixation oculaire (P) coïncide avec le centre de ladite zone d'affichage (A),

    ledit œil gauche (2) est à une deuxième distance prédéterminée (D2) de ladite zone d'affichage (A), et

    ledit premier axe (x2) et ledit deuxième axe (y2) dudit système de référence oculaire gauche sont parallèles respectivement audit premier axe (x) et audit deuxième axe (y) dudit système de référence d'affichage ;

    C) déterminer
    pour ladite au moins une première partie de trame vidéo de ladite au moins une première trame vidéo (FD11,FD12...FD1N), un ou plusieurs premiers filtres numériques (11) configurés pour changer la valeur d'un ou plusieurs pixels de ladite au moins une première partie de trame vidéo, chacune étant associée à une première partie prédéterminée de trame vidéo respective, et/ou
    pour ladite au moins une deuxième partie de trame vidéo de ladite au moins une première trame vidéo (FD11,FD12...FD1N), un ou plusieurs deuxièmes filtres numériques (12) configurés pour changer la valeur d'un ou plusieurs pixels de ladite au moins une deuxième partie de trame vidéo, chacune étant associée à une deuxième partie prédéterminée de trame vidéo respective ;

    D) configurer
    pour l'œil droit (1), un premier schéma de correction ou schéma de correction droit (SCDX) comprenant lesdits un ou plusieurs premiers filtres numériques (11), dans lequel ledit schéma de correction droit (SCDX) est une première structure de données configurée pour modifier ladite au moins une première partie de trame vidéo, dans laquelle ladite première structure de données comprend des informations relatives auxdits un ou plusieurs premiers filtres numériques (11), les informations relatives auxdites forme, taille et position de chacune desdites premières parties de trame vidéo et des informations relatives aux associations desdites premières parties de trame vidéo avec chacun desdits premiers filtres numériques (11) ; ledit schéma de correction droit (SCDX) ayant un format graphique de façon à être affiché avec une première image prédéterminée, dans lequel une ou plusieurs parties de ladite première image prédéterminée sont associées à un premier filtre numérique respectif (11) et chaque premier filtre numérique (11) est associé à une première partie de trame vidéo prédéterminée respective,
    et/ou
    pour l'œil gauche (2), un deuxième schéma de correction ou schéma de correction gauche (SCSX) comprenant lesdits un ou plusieurs deuxièmes filtres numériques (12), dans lequel ledit schéma de correction gauche (SCSX) est une deuxième structure de données configurée pour modifier ladite au moins une deuxième partie de trame vidéo, dans laquelle ladite deuxième structure de données comprend des informations relatives auxdits un ou plusieurs deuxièmes filtres numériques (12), les informations relatives auxdites forme, taille et position de chacune desdites deuxièmes parties de trame vidéo et des informations relatives à des associations desdites deuxièmes parties de trame vidéo avec chacun desdits deuxièmes filtres numériques (12) ; ledit schéma de correction gauche (SCSX) ayant un format graphique de façon à être affiché avec une deuxième image prédéterminée, dans lequel une ou plusieurs parties de ladite deuxième image prédéterminée sont associées à un deuxième filtre numérique respectif (12) et chaque deuxième filtre numérique (12) est associé à une deuxième partie de trame vidéo prédéterminée respective ;

    E) acquérir un deuxième flux vidéo numérique (FD2), dans lequel ledit deuxième flux vidéo numérique (FD2) comprend une succession de deuxièmes trames vidéo (FD21,FD22...FD2N), lesdites deuxièmes trames vidéo (FD21,hFD22...FD2N) dudit deuxième flux numérique (FD2) étant des trames vidéo se référant à un contenu visuel affichable sur ladite zone d'affichage (A) ;

    F) calculer
    pour l'œil droit (1), une première position de l'origine (O1) et une première orientation dudit système de référence oculaire droit par rapport audit système de référence d'affichage, et/ou
    pour l'œil gauche (2), une deuxième position de l'origine (O2) et une deuxième orientation dudit système de référence oculaire gauche par rapport audit système de référence d'affichage ;

    G) comparer
    en référence audit œil droit (1), la première position de l'origine (O1) dudit système de référence oculaire droit avec ladite première position prédéterminée de l'origine (O1) dans les premières conditions prédéterminées pour vérifier si ladite première position de l'origine (O1) est différente de ladite première position prédéterminée, et/ou la première orientation dudit système de référence oculaire droit avec ladite première orientation prédéterminée dans les premières conditions prédéterminées pour vérifier si ladite première orientation est différente de ladite première orientation prédéterminée, et/ou
    en référence audit œil gauche (2), la deuxième position de l'origine (O2) dudit système de référence oculaire gauche avec la deuxième position prédéterminée de l'origine (O2) dans les deuxièmes conditions prédéterminées pour vérifier si ladite deuxième position de l'origine (O2) est différente de ladite deuxième position prédéterminée, et/ou la deuxième orientation dudit système de référence oculaire gauche avec ladite deuxième orientation prédéterminée dans les deuxièmes conditions prédéterminées pour vérifier si ladite deuxième orientation est différente de ladite deuxième orientation prédéterminée ;

    H) lorsque ladite première position de l'origine (O1) dudit système de référence oculaire droit est différente de ladite première position prédéterminée de l'origine (O1) et/ou ladite première orientation dudit système de référence oculaire droit est différente de ladite première orientation prédéterminée, reconfigurer ledit schéma de correction droit (SCDX) sur la base de ladite première position de l'origine (O1) et/ou de ladite première orientation, de sorte que lesdits un ou plusieurs premiers filtres numériques (11) soient appliqués aux premières parties de trame vidéo respectives, différentes desdites premières parties de trame vidéo prédéterminées, et/ou
    lorsque ladite deuxième position de l'origine (O2) dudit système de référence oculaire gauche est différente de ladite deuxième position prédéterminée de l'origine (O2), et/ou ladite deuxième orientation est différente de ladite deuxième orientation prédéterminée, reconfigurer ledit schéma de correction gauche (SCSX) sur ladite deuxième position de l'origine (O2) et/ou de ladite deuxième orientation, de sorte qu'un ou plusieurs deuxièmes filtres numériques (12) soient appliqués à une ou plusieurs premières parties de trame vidéo respectives, différentes desdites deuxièmes parties de trame vidéo prédéterminées ;

    I) appliquer
    ledit schéma de correction droit (SCDX) à au moins une deuxième trame vidéo (FD21,hFD22...FD2N) dudit deuxième flux vidéo numérique (FD2) de sorte qu'un ou plusieurs premiers filtres numériques (11) sont appliqués à au moins une première partie de trame vidéo, de sorte à obtenir un troisième flux vidéo numérique ou flux numérique droit (FD2DX) pour l'œil droit (1), différent dudit deuxième flux vidéo numérique (FD2), dans lequel ledit flux numérique droit (FD2DX) comprend au moins une deuxième trame vidéo modifiée (FD21',FD22'...FD2N'), et/ou
    ledit schéma de correction gauche (SCSX) à au moins une deuxième trame vidéo (FD21,hFD22...FD2N) dudit deuxième flux vidéo numérique (FD2) de sorte que lesdits un ou plusieurs deuxièmes filtres numériques (12) sont appliqués à au moins une deuxième partie de trame vidéo, de sorte à obtenir un quatrième flux vidéo numérique ou flux numérique gauche (FD2SX) pour l'œil gauche (2), différent dudit deuxième flux vidéo numérique (FD2), dans lequel ledit flux numérique gauche (FD2SX) comprend au moins une autre deuxième trame vidéo modifiée (FD21",FD22"...FD2N") ;

    L) générer un flux vidéo numérique à vues multiples (MV) comprenant une première séquence de trames vidéo associée audit deuxième flux vidéo numérique (FD2) ou audit flux vidéo numérique droit (FD2DX), et une deuxième séquence de trames vidéo associée audit deuxième flux vidéo numérique (FD2) ou ledit flux vidéo numérique gauche (FD2SX) ;

    M) afficher ledit flux vidéo numérique à vues multiples (MV) par ledit système vidéo stéréoscopique ou autostéréoscopique (7) de sorte que ladite première séquence de trames vidéo dudit flux vidéo numérique à vues multiples (MV) soit vue par ledit œil droit (1) et ladite deuxième séquence de trames vidéo dudit flux vidéo numérique à vues multiples (MV) soit vue par ledit œil gauche (2).


     
    2. Procédé selon la revendication précédente, caractérisé en ce que si ledit œil droit (1) et/ou ledit œil gauche (2) bouge et/ou la tête de ladite personne bouge, ledit procédé comprend en outre les étapes suivantes consistant à :

    F') calculer
    pour ledit œil droit (1), une autre première position de l'origine (O1) et une autre première orientation dudit système de référence oculaire droit par rapport audit système de référence d'affichage, et/ou
    pour ledit œil gauche (2), une autre deuxième position de l'origine (O2) et une autre deuxième orientation dudit système de référence oculaire gauche par rapport audit système de référence d'affichage ;

    G1) comparer
    ladite autre première position de l'origine (O1) dudit système de référence oculaire droit avec ladite première position prédéterminée de l'origine (O1) dans les premières conditions prédéterminées pour vérifier si ladite autre première position de l'origine (O1) dudit système de référence oculaire droit est différente de ladite première position prédéterminée et/ou ladite autre première orientation dudit système de référence oculaire droit avec ladite première orientation prédéterminée dans les premières conditions prédéterminées afin de vérifier si ladite autre première orientation est différente de ladite première orientation prédéterminée, et/ou
    ladite autre deuxième position de l'origine (O2) dudit système de référence oculaire gauche avec ladite deuxième position prédéterminée de l'origine (O2) dans les deuxièmes conditions prédéterminées pour vérifier si ladite autre deuxième position de l'origine (O2) est différente de ladite deuxième position prédéterminée, et/ou ladite deuxième orientation dudit système de référence oculaire gauche avec ladite deuxième orientation prédéterminée dans les deuxièmes conditions prédéterminées afin de vérifier si ladite autre deuxième orientation est différente de ladite deuxième orientation prédéterminée ;

    G2) pour ledit œil droit (1), comparer
    ladite autre première position de l'origine (O1) dudit système de référence oculaire droit avec ladite première position pour vérifier si ladite autre première position de l'origine (O1) est différente de ladite première position de l'origine (O1), lorsque ladite autre première position de l'origine (O1) dudit système de référence oculaire droit est différente de ladite première position prédéterminée de l'origine (O1) dans les premières conditions prédéterminées, et/ou de ladite autre première orientation dudit système de référence oculaire droit avec ladite première orientation pour vérifier si ladite autre première orientation est différente de ladite première orientation, lorsque ladite autre première orientation dudit système de référence oculaire droit est différente de ladite première orientation prédéterminée dans les premières conditions prédéterminées,
    et/ou
    pour ledit œil gauche (2), comparer
    ladite autre deuxième position de l'origine (O2) dudit système de référence oculaire gauche avec ladite deuxième position de l'origine (O2) pour déterminer si ladite autre deuxième position de l'origine (O2) est différente de ladite deuxième position de l'origine (O2), lorsque ladite autre deuxième position de l'origine (O2) dudit système de référence oculaire gauche est différente de ladite deuxième position prédéterminée de l'origine (O2) dans les deuxièmes conditions prédéterminées, et/ou de ladite autre deuxième orientation dudit système de référence oculaire gauche avec ladite deuxième orientation pour vérifier si ladite autre deuxième orientation est différente de ladite deuxième orientation lorsque ladite autre deuxième orientation dudit système de référence oculaire gauche est différente de ladite deuxième orientation prédéterminée dans les deuxièmes conditions prédéterminées ;

    H') reconfigurer ledit schéma de correction droit (SCDX) sur la base de ladite autre première position de l'origine (O1) telle que calculée, lorsque ladite autre première position de l'origine (O1) dudit système de référence oculaire droit est différente de ladite première position de l'origine (O1), et/ou sur la base de ladite autre première orientation telle que calculée, lorsque ladite autre première orientation est différente de ladite première orientation, et/ou
    reconfigurer ledit schéma de correction gauche (SCSX) sur la base de ladite autre deuxième position de l'origine (O2) telle que calculée, lorsque ladite autre deuxième position de l'origine (O2) dudit système de référence oculaire gauche est différente de ladite deuxième position de l'origine (O2), et/ou sur la base de ladite autre deuxième orientation telle que calculée, lorsque ladite autre deuxième orientation est différente de ladite deuxième orientation.


     
    3. Procédé selon l'une quelconque des revendications précédentes, caractérisé en ce que chacune desdites premières trames vidéo est une grille d'Amsler.
     
    4. Procédé selon l'une quelconque des revendications précédentes, caractérisé en ce que chaque premier filtre numérique (11) est représenté graphiquement dans une partie respective de ladite première image prédéterminée dudit schéma de correction droit (SCDX) et en ce que chaque deuxième filtre numérique (12) est représenté graphiquement dans une autre partie respective de ladite deuxième image prédéterminée dudit schéma de correction gauche (SCSX).
     
    5. Procédé selon l'une quelconque des revendications précédentes, caractérisé en ce que ledit contenu visuel dudit deuxième flux vidéo numérique (FD2) est une image ou une émission de télévision ou une vidéo en direct ou une vidéo enregistrée ou une sortie vidéo d'un ordinateur.
     
    6. Système pour modifier une ou plusieurs trames vidéo d'un flux vidéo numérique affichable sur une zone d'affichage (A), ledit système comprenant :

    - une première source vidéo numérique (SV1) configurée pour fournir un premier flux vidéo numérique (FD1), dans lequel ledit premier flux vidéo numérique (FD1) comprend une succession de premières trames vidéo (FD11,FD12...FD1N) ; lesdits un ou plusieurs premiers filtres numériques (11) et/ou lesdits un ou plusieurs deuxièmes filtres numériques (12) étant déterminés par rapport audit premier flux vidéo numérique (FD1),

    - une deuxième source vidéo (SV2) configurée pour fournir un deuxième flux vidéo numérique (FD2), dans lequel ledit deuxième flux vidéo numérique (FD2) comprend une succession de deuxièmes trames vidéo (FD21,FD22...FD2N), lesdites deuxièmes trames vidéo (FD21,hFD22...FD2N) dudit deuxième flux numérique (FD2) étant liées à un contenu visuel affichable sur ladite zone d'affichage (A) ;

    - un système de suivi (5) pour suivre un point de fixation oculaire (P) dans ladite zone d'affichage (A), au moins configuré pour calculer :

    pour l'œil droit (1), une première position de l'origine (O1) et une première orientation d'un système de référence oculaire droit par rapport à un système de référence d'affichage, ledit système de référence oculaire droit étant un système de référence cartésien tridimensionnel, solidaire du globe oculaire dudit œil droit (1), ayant une origine (O1) au centre de la cornée dudit œil droit (1) et comprenant un premier axe (x1), un deuxième axe (y1) et un troisième axe (z1), dans lequel ledit deuxième axe (y1) est orthogonal à un axe interpupillaire (B), dans lequel ledit axe interpupillaire (B) est une ligne droite passant par le centre de la cornée de l'œil droit (1) et le centre de la cornée de l'œil gauche (2), et ledit troisième axe (z1) coïncide avec un premier axe visuel (V1), dans lequel ledit premier axe visuel (V1) est une ligne droite passant par le centre de la cornée de l'œil droit (1) et ledit point de fixation oculaire (P), un système de référence d'affichage est associé à ladite zone d'affichage (A), ledit système de référence d'affichage étant un système de référence cartésien tridimensionnel ayant une origine (O) au centre de ladite zone d'affichage (A) et comprenant un premier axe (x), un deuxième axe (y) et un troisième axe (z), dans lequel ledit premier axe (x) est horizontal et ledit troisième axe (z) est perpendiculaire à un plan d'affichage, dans lequel ledit plan d'affichage est un plan passant par ladite zone d'affichage (A) agencé de sorte que ladite zone d'affichage (A) appartient audit plan d'affichage,

    et/ou

    pour l'œil gauche (2), une deuxième position de l'origine (O2) et une deuxième orientation dudit système de référence oculaire gauche par rapport audit système de référence d'affichage, ledit système de référence oculaire gauche étant un système de référence cartésien tridimensionnel, solidaire du globe oculaire dudit œil gauche (2), ayant une origine (O2) au centre de ladite cornée de l'œil gauche (2) et comprenant un premier axe (x2), un deuxième axe (y2) et un troisième axe (z2), dans lequel ledit deuxième axe (y2) est orthogonal audit axe interpupillaire (B) et ledit troisième axe (z2) coïncide avec un deuxième axe visuel (V2), dans lequel ledit deuxième axe visuel (V2) est une ligne droite passant par le centre de ladite cornée de l'œil gauche (2) et dudit point de fixation de l'œil (P) ;

    - un dispositif de correction (6) adapté pour modifier les trames vidéo d'un flux vidéo numérique sur la base de défauts visuels perçus en raison d'une maladie dégénérative de la rétine, dans lequel sont stockés un premier schéma de correction ou schéma de correction droit (SCDX) comprenant un ou plusieurs premiers filtres numériques (11) configurés pour changer la valeur d'un ou plusieurs pixels d'au moins une première partie de trame vidéo, dans lequel chaque premier filtre numérique (11) est associé à au moins une première partie prédéterminée de la trame vidéo, et/ou un deuxième schéma de correction ou schéma de correction gauche (SCSX) comprenant un ou plusieurs deuxièmes filtres numériques (12) configurés pour changer la valeur d'un ou plusieurs pixels d'au moins une deuxième partie de trame vidéo, dans lequel chaque deuxième filtre numérique (12) est associé à au moins une partie prédéterminée de la deuxième trame vidéo, ledit schéma de correction droit (SCDX) étant une première structure de données comprenant des informations relatives auxdits un ou plusieurs premiers filtres numériques (11), les informations relatives à la forme, la taille et la position d'au moins une première partie de trame vidéo à laquelle au moins un premier défaut visuel est perçu par une personne, et des informations sur les associations relatives auxdites premières parties de trame vidéo avec chacun desdits premiers filtres numériques (11) ; ledit schéma de correction droit (SCDX) ayant un format graphique de sorte à être affiché avec une première image prédéterminée, dans lequel une ou plusieurs parties de ladite première image prédéterminée sont associées à un premier filtre numérique respectif (11) et chaque premier filtre numérique (11) est associé à une première partie de trame vidéo prédéterminée respective, ledit schéma de correction gauche (SCSX) étant une deuxième structure de données comprenant des informations relatives auxdits un ou plusieurs deuxièmes filtres numériques (12), les informations relatives à la forme, la taille et la position d'au moins une deuxième partie de trame vidéo à laquelle au moins un deuxième défaut visuel est perçu par une personne, et des informations relatives aux associations desdites deuxièmes parties de trame vidéo avec chacun desdits deuxièmes filtres numériques (12) ; ledit schéma de correction gauche (SCSX) ayant un format graphique de sorte à être affiché avec une deuxième image prédéterminée, dans lequel une ou plusieurs parties de ladite deuxième image prédéterminée sont associées à un deuxième filtre numérique respectif (12) et chaque deuxième filtre numérique (12) est associé à une deuxième partie de trame vidéo prédéterminée respective ;

    - un système vidéo stéréoscopique ou autostéréoscopique (7), dans lequel ledit système vidéo stéréoscopique ou autostéréoscopique (7) comprend un dispositif d'affichage (71) pourvu de ladite zone d'affichage (A),
    dans lequel
    ledit dispositif de correction (6) est connecté à ladite première source vidéo (SV1) et à ladite deuxième source vidéo (SV2), ainsi qu'audit système de suivi (5) et audit système vidéo stéréoscopique ou autostéréoscopique (7), et est configuré pour au moins :

    - acquérir un deuxième flux vidéo numérique (FD2), dans lequel ledit deuxième flux vidéo numérique comprend une succession de deuxièmes trames vidéo (FD21,FD22...FD2N) ;

    - recevoir à partir dudit système de suivi
    en référence audit œil droit (1), ladite première position de l'origine (O1) et/ou ladite première orientation dudit système de référence oculaire droit, et/ou
    en référence audit œil gauche (2), ladite deuxième position de l'origine (O2) et/ou ladite deuxième orientation dudit système de référence oculaire gauche ;

    - comparer
    en référence audit œil droit (1), ladite première position de l'origine (O1) dudit système de référence oculaire droit avec une première position prédéterminée de l'origine (O1) pour déterminer si ladite première position de l'origine (O1) est différente à partir de ladite première position prédéterminée, et/ou de ladite première orientation dudit système de référence oculaire droit avec une première orientation prédéterminée afin de vérifier si ladite première orientation est différente de ladite première orientation prédéterminée, ladite première position prédéterminée de l'origine (O1) et ladite première orientation prédéterminée sont telles que les premières conditions prédéterminées suivantes sont satisfaites :

    • ledit point de fixation oculaire (P) coïncide avec le centre de ladite zone d'affichage (A),

    • ledit œil droit (1) est à une première distance prédéterminée (D1) de ladite zone d'affichage (A), et

    • ledit premier axe (x1) et ledit deuxième axe (y1) dudit système de référence oculaire droit sont parallèles respectivement audit premier axe (x) et audit deuxième axe (y) dudit système de référence d'affichage ;

    et/ou
    en référence audit œil gauche (2), ladite deuxième position de l'origine (O2) dudit système de référence oculaire gauche avec une deuxième position prédéterminée de l'origine (O2) pour déterminer si ladite deuxième position de l'origine (O2) est différente à partir de ladite deuxième position prédéterminée, et/ou de ladite deuxième orientation dudit système de référence oculaire gauche avec une deuxième orientation prédéterminée afin de vérifier si ladite deuxième orientation est différente de ladite deuxième orientation prédéterminée, ladite deuxième position prédéterminée de l'origine (O2) et ladite deuxième orientation prédéterminée sont telles que les deuxièmes conditions prédéterminées suivantes sont satisfaites :

    • ledit point de fixation oculaire (P) coïncide avec le centre de ladite zone d'affichage (A),

    • ledit œil gauche (2) est à une deuxième distance prédéterminée (D2) de ladite zone d'affichage (A), et

    • ledit premier axe (x2) et ledit deuxième axe (y2) dudit système de référence oculaire gauche sont parallèles respectivement audit premier axe (x) et audit deuxième axe (y) dudit système de référence d'affichage ;

    - reconfigurer ledit schéma de correction droit (SCDX) sur la base de ladite première position de l'origine (O1) et/ou de ladite première orientation, de sorte que lesdits un ou plusieurs premiers filtres numériques (11) soient appliqués aux premières parties de trame vidéo respectives, différente desdites premières parties de trame vidéo prédéterminées, lorsque ladite première position de l'origine (O1) dudit système de référence oculaire droit est différente de ladite première position prédéterminée de l'origine (O1) et/ou ladite première orientation dudit système de référence oculaire droit est différente de ladite première orientation prédéterminée, et/ou reconfigurer ledit schéma de correction gauche (SCSX) sur la base de ladite deuxième position de l'origine (O2) et/ou de ladite deuxième orientation, de sorte qu'un ou plusieurs deuxièmes filtres numériques (12) soient appliqués à une ou plusieurs deuxièmes parties de trame vidéo respectives, différentes desdites deuxièmes parties de trame vidéo prédéterminées, lorsque ladite deuxième position de l'origine (O2) dudit système de référence oculaire gauche est différente de ladite deuxième position prédéterminée de l'origine (O2) et/ou ladite deuxième orientation est différente de ladite deuxième orientation prédéterminée ;

    - appliquer
    ledit schéma de correction droit (SCDX) à au moins une deuxième trame vidéo (FD21,FD22...FD2N) dudit deuxième flux vidéo numérique (FD2) de sorte qu'un ou plusieurs desdits premiers filtres numériques (11) sont appliqués à au moins une première partie de trame vidéo, de sorte à obtenir un troisième flux vidéo numérique ou flux numérique droit (FD2DX) pour l'œil droit (1), différent dudit deuxième flux vidéo numérique (FD2), dans lequel ledit flux numérique droit (FD2DX) comprend au moins une deuxième trame vidéo modifiée (FD21',FD22'...FD2N'), et/ou
    ledit schéma de correction gauche (SCSX) à au moins une deuxième trame vidéo (FD21,FD22...FD2N) dudit deuxième flux vidéo numérique (FD2) de sorte que lesdits un ou plusieurs deuxièmes filtres numériques (12) sont appliqués à au moins une deuxième partie de trame vidéo, de sorte à obtenir un quatrième flux vidéo numérique ou flux numérique gauche (FD2SX) pour l'œil gauche (2), différent dudit deuxième flux vidéo numérique (FD2), dans lequel ledit flux numérique gauche (FD2sx) comprend au moins une autre deuxième trame vidéo modifiée (FD21",FD22"...FD2N") ;

    - générer un flux vidéo numérique à vues multiples (MV) comprenant une première séquence de trames vidéo associée audit deuxième flux vidéo numérique (FD2) ou audit flux vidéo numérique droit (FD2DX), et une deuxième séquence de trames vidéo associée audit deuxième flux vidéo numérique (FD2) ou ledit flux vidéo numérique gauche (FD2SX) ;

    - exécuter un codage vidéo compatible avec ledit système vidéo stéréoscopique ou autostéréoscopique (7) ;

    ledit système vidéo stéréoscopique ou autostéréoscopique (7) est configuré pour :

    - recevoir comme entrée ledit flux vidéo numérique à vues multiples (MV)

    - afficher ledit flux vidéo numérique à vues multiples (MV) de sorte que ladite première séquence de trames vidéo dudit flux vidéo numérique à vues multiples (MV) soit vue par ledit œil droit (1) et ladite deuxième succession de trames vidéo dudit flux vidéo numérique à vues multiples (MV) soit vue par ledit œil gauche (2).


     
    7. Système selon la revendication précédente, caractérisé en ce que ledit schéma de correction droit (SCDX) comprend une pluralité de premiers filtres numériques (11), et ledit schéma de correction gauche (SCSX) comprend une pluralité desdits deuxièmes filtres numériques (12).
     
    8. Système selon la revendication 6 ou 7, caractérisé en ce que chaque premier filtre numérique (11) est représenté graphiquement dans une partie respective de ladite première image prédéterminée dudit schéma de correction droit (SCDX) et en ce que chaque deuxième filtre numérique (12) est représenté graphiquement dans une autre partie respective de ladite deuxième image prédéterminée dudit schéma de correction gauche (SCsx).
     
    9. Système selon l'une quelconque des revendications 6 à 8, caractérisé en ce que ladite première source vidéo (SV1) est ladite deuxième source vidéo (SV2).
     
    10. Système selon l'une quelconque des revendications 6 à 9, caractérisé en ce que ledit contenu visuel est une image ou une émission de télévision ou une vidéo en direct ou une vidéo enregistrée ou une sortie vidéo d'un ordinateur.
     




    Drawing









































    Cited references

    REFERENCES CITED IN THE DESCRIPTION



    This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

    Patent documents cited in the description