TECHNICAL FIELD
[0002] The present invention relates to the field of communications technologies, and in
particular, to a screencast recording method, a screencast playing method, a screen
recording terminal, and a playing terminal.
BACKGROUND
[0003] With rapid development of communications technologies, a user needs to continuously
learn and master a new technology, to obtain a service of better quality. As mobile
terminals are popularized, there is a relatively large difference between mobile terminal
users in terms of ages, learning abilities, and the like. To provide users with a
more comprehensive learning tutorial and a more convenient learning approach, a screen
recording (that is, screencast recording) technology emerges.
[0004] A conventional screen recording technology is: In a screen recording process, a mobile
terminal records content displayed on a screen to obtain a video, to record operation
steps performed by a user on the screen, and then the recorded video is used to instruct
another user to complete some unfamiliar or relatively complex operations. Because
in a video recording process, a time interval between operation steps is mainly controlled
by a user who records a video, a time interval between two operation steps in the
recorded video may be relatively short because the user is skillful. In this case,
when another user watches the video, the another user may be unable to master an entire
operation process because the another user does not know the operation steps and overall
coherence of the operation steps is relatively high. In addition, for a cumbersome
operation process, a large quantity of operation steps may be involved in a recorded
video, and another user with a relatively poor learning ability may also be unable
to master an entire operation process. It can be learned that, although the screen
recording technology can be used to present complete operation steps performed by
a user to another user, the another user probably performs a misoperation in an actual
operation process because the another user cannot master an entire operation process.
SUMMARY
[0005] Embodiments of the present invention provide a screencast recording method, a screencast
playing method, a screen recording terminal, and a playing terminal, to resolve a
problem that another user generates a misoperation in an actual use process of a screen
recording technology.
[0006] To achieve the foregoing objective, the embodiments of the present invention use
the following technical solutions.
[0007] According to a first aspect, an embodiment of the present invention provides a screencast
recording method. The method is applied to a screen recording terminal, and the recording
method includes: obtaining an operation performed by a screen recording user on the
screen recording terminal, and determining screen content and event content that are
corresponding to the operation, where the event content includes at least content
used to indicate a manner of generating the operation; then generating video data
and a screen recording operation intelligent playback part based on the screen content
and the event content, where the screen recording operation intelligent playback part
includes at least corresponding screen content and event content that are used to
indicate all operations in the video data; and finally generating a screen recording
file that includes the video data and the screen recording operation intelligent playback
part.
[0008] In a possible design, the screen recording operation intelligent playback part in
the screen recording file may further include a voice auxiliary bit identifier. If
audio exists for an operation corresponding to the voice auxiliary bit identifier
in a process of generating the operation, the voice auxiliary bit identifier may be
set to be valid. According to a second aspect, an embodiment of the present invention
provides a screen recording terminal, and the screen recording terminal can implement
functions performed in the foregoing method embodiment. The functions may be implemented
by hardware, or may be implemented by hardware by executing corresponding software.
The hardware or software includes one or more modules corresponding to the functions.
[0009] In a possible design, a structure of the screen recording terminal includes a processor
and a transceiver. The processor is configured to support the screen recording terminal
in performing a corresponding function in the foregoing method. The transceiver is
configured to support communication between the apparatus and another device such
as a playing terminal. The screen recording terminal may further include a memory,
and the memory is coupled to the processor and stores a program instruction and data
required by the apparatus.
[0010] According to a third aspect, an embodiment of the present invention provides a computer
storage medium. The computer storage medium is configured to store a computer software
instruction used by the foregoing screen recording terminal, and the computer software
instruction includes a program designed for executing the foregoing aspects.
[0011] According to a fourth aspect, an embodiment of the present invention provides a screencast
playing method. The method is applied to a playing terminal, and the playing method
includes: obtaining a screen recording file, where the screen recording file includes
at least video data and a screen recording operation intelligent playback part, the
screen recording operation intelligent playback part includes at least corresponding
screen content and event content that are used to indicate at least one operation
in the video data, and the event content includes at least content used to indicate
a manner of generating the at least one operation; and after an intelligent playback
instruction is received, performing the at least one operation according to the intelligent
playback instruction, where the intelligent playback instruction is used to trigger
playing of the screen recording operation intelligent playback part and performing
of the at least one operation on the playing terminal.
[0012] In a possible design, after the intelligent playback instruction is received, if
resolution of the playing terminal is different from resolution of a screen recording
terminal, coordinates of a screen touching operation generated on the screen recording
terminal in the video data are converted into specified coordinates on the playing
terminal. The screen recording terminal is a terminal that generates the screen recording
file. Then the at least one operation is performed on the playing terminal based on
the specified coordinates. It can be learned that, in the foregoing possible design,
a problem of an inconsistent operation or a misoperation caused by different resolution
of the screen recording terminal and the playing terminal can be effectively avoided.
For a playing terminal and a screen recording terminal with same resolution, event
content of at least one input event can be directly performed without screen adaption.
For a playing terminal and a screen recording terminal with different resolution,
after screen adaptation is completed, intelligent playback of the screen recording
file can be performed provided that resolution of the playing terminal and resolution
of the screen recording terminal are the same.
[0013] In a possible design, if the at least one operation includes at least two operations,
a process of performing the at least one operation may be implemented as follows:
if the resolution of the playing terminal is the same as the resolution of the screen
recording terminal, successively performing all of the at least one operation. It
can be learned that input events are successively performed based on a specific sequence,
while a user does not need to successively perform, by imitating event content of
each input event in the screen recording file, operations corresponding to a plurality
of steps. In this way, not only operation steps can be reduced for the user, but also
it can be ensured that all the input events are successively triggered, to complete
an entire screen recording playback process.
[0014] In a possible design, the process of performing the at least one operation may be
implemented by using different implementation processes based on whether current screen
content is the same as screen content on which a specified operation is generated.
If the current screen content is the same as the screen content on which the specified
operation is generated, the specified operation is performed. If the current screen
content is different from the screen content on which the specified operation is generated,
interface matching is performed until the current screen content is the same as the
screen content on which the specified operation is generated, and then the specified
operation is performed.
[0015] In a possible design, the performing interface matching until the current screen
content is the same as the screen content on which the specified operation is generated
may be specifically: obtaining display content of a specified area in an interface
in which the specified operation is generated, and then detecting, based on a specified
interval, whether an area that is the same as the display content exists in the current
screen content, and when the area that is the same as the display content exists,
determining that the current screen content is the screen content on which the specified
operation is generated. In this case, if the playing terminal still uses a time interval
of performing corresponding operations on the screen recording terminal, once performance
of the playing terminal is relatively poor, a time for a process of performing an
interface jump or other instruction processing by the playing terminal may be longer
than that for performing a corresponding operation on the screen recording terminal.
Consequently, it is possible that a corresponding interface jump has not occurred
on the playing terminal, or currently a next executable operation does not exist on
the playing terminal. Therefore, to avoid the foregoing case, when the event content
of each input event is being performed, an interface matching operation needs to be
completed by determining whether a current interface is an interface in which a specified
input event is generated, and after interface matching succeeds, a corresponding operation
is performed, thereby increasing a success rate of implementing intelligent playback,
and effectively avoiding a problem such as an intelligent playback failure or intelligent
playback termination caused by a performance difference between two terminals.
[0016] In a possible design, before the obtaining display content of a specified area in
an interface in which the specified operation is generated, the playing method may
further include: obtaining a package name and a class name of an application corresponding
to the specified operation in the screen recording file; then determining, based on
the package name of the application, the application corresponding to the specified
operation, and accessing the application; and if the screen recording file has permission
to access the application, determining, based on the class name, a specified interface
corresponding to the specified operation, and jumping to the specified interface.
It can be learned that, whether the screen recording file has the permission to access
the application also affects a success rate of a screen recording intelligent playback
process. Therefore, in the foregoing possible design, different implementation procedures
are provided for the two cases: having access permission and having no access permission.
[0017] In a possible design, after the determining, based on the package name of the application,
the application corresponding to the specified operation, and accessing the application,
the playing method may further include: if the screen recording file has no permission
to access the application, generating prompt information, where the prompt information
is used to prompt a user to enable the permission to access the application; and after
the screen recording file has the permission to access the application, determining,
based on the class name, the specified interface corresponding to the specified operation,
and jumping to the specified interface. It can be learned that before starting the
entire intelligent playback process, the playing terminal first jumps to the interface
corresponding to the specified input event, so that after starting the intelligent
playback, the playing terminal can directly complete, based on content recorded in
the screen recording operation intelligent playback part, an operation corresponding
to the at least one input event.
[0018] In a possible design, the screen recording operation intelligent playback part may
further include a voice auxiliary bit identifier, and when the specified operation
is being performed, if the voice auxiliary bit identifier is valid, audio corresponding
to the specified operation is played. Because a user who uses intelligent playback
may be a user with a visual impairment, to help the user know operation steps in the
entire intelligent playback process, in the foregoing possible design, the screen
recording file further includes a voice auxiliary bit identifier. In a process in
which the playing terminal performs intelligent playback, the playing terminal may
choose, based on information recorded in the voice auxiliary bit, whether to play
audio corresponding to an operation that is being performed, and play the audio when
the audio needs to be played.
[0019] In a possible design, after performing the at least one operation, the playing terminal
may jump from a current interface to an interface existing before the at least one
operation is performed. In this way, after performing the at least one operation,
based on a requirement of the user, the playing terminal may jump from the current
interface to the display interface existing before the at least one operation is performed.
[0020] According to a fifth aspect, an embodiment of the present invention provides a playing
terminal, and the playing terminal can implement functions performed in the foregoing
method embodiment. The functions may be implemented by hardware, or may be implemented
by hardware by executing corresponding software. The hardware or software includes
one or more modules corresponding to the functions.
[0021] In a possible design, a structure of the playing terminal includes a processor and
a transceiver. The processor is configured to support the playing terminal in performing
a corresponding function in the foregoing method. The transceiver is configured to
support communication between the apparatus and another device such as a screen recording
terminal. The playing terminal may further include a memory, and the memory is coupled
to the processor and stores a program instruction and data required by the apparatus.
[0022] According to a sixth aspect, an embodiment of the present invention provides a computer
storage medium. The computer storage medium is configured to store a computer software
instruction used by the foregoing playing terminal, and the computer software instruction
includes a program designed for executing the foregoing aspects. Compared with the
prior art in which another user performs a misoperation in an actual operation process
because the another user cannot master an entire operation process, in the embodiments
of the present invention, after the intelligent playback instruction is received,
the event content of the at least one input event in the obtained screen recording
file can be performed. It can be learned that the foregoing implementation process
is performed by the playing terminal based on the screen recording file, while the
user does not need to manually complete each operation step presented in a recorded
video after watching the video. In this way, a manual operation process of the user
can be simplified, thereby resolving a problem of a misoperation caused by a manual
operation performed by the user.
BRIEF DESCRIPTION OF DRAWINGS
[0023]
FIG. 1 is a schematic diagram of a display interface of a playing terminal according
to an embodiment of the present invention;
FIG. 2 is a flowchart of a screencast recording method according to an embodiment
of the present invention;
FIG. 3 is a schematic structural diagram of a screen recording file according to an
embodiment of the present invention;
FIG. 4 is a schematic diagram of a display interface of a screen recording terminal
according to an embodiment of the present invention;
FIG. 5 is a flowchart of a screencast playing method according to an embodiment of
the present invention;
FIG. 6 is a schematic diagram of another display interface of a playing terminal according
to an embodiment of the present invention;
FIG. 7 is a flowchart of another screencast playing method according to an embodiment
of the present invention;
FIG. 8 is a schematic diagram of another display interface of a playing terminal according
to an embodiment of the present invention;
FIG. 9, FIG. 10, and FIG. 11 are flowcharts of another screencast playing method according
to an embodiment of the present invention;
FIG. 12 is a schematic diagram of a display interface of WeChat according to an embodiment
of the present invention;
FIG. 13 and FIG. 14 are flowcharts of another screencast playing method according
to an embodiment of the present invention;
FIG. 15 is a schematic diagram of another display interface of WeChat according to
an embodiment of the present invention;
FIG. 16 is a schematic structural diagram of a screen recording terminal according
to an embodiment of the present invention;
FIG. 17 is a schematic structural diagram of a playing terminal according to an embodiment
of the present invention;
FIG. 18 and FIG. 20 are schematic structural diagrams of another screen recording
terminal according to an embodiment of the present invention; and
FIG. 19 and FIG. 21 are schematic structural diagrams of another playing terminal
according to an embodiment of the present invention.
DESCRIPTION OF EMBODIMENTS
[0024] The following clearly and completely describes the technical solutions in the embodiments
of the present invention with reference to the accompanying drawings in the embodiments
of the present invention. Apparently, the described embodiments are merely some but
not all of the embodiments of the present invention. All other embodiments obtained
by a person of ordinary skill in the art based on the embodiments of the present invention
without creative efforts shall fall within the protection scope of the embodiments
of the present invention.
[0025] The embodiments of the present invention may be applied to a terminal. The terminal
may be a screen recording terminal or a playing terminal, and may be specifically
a mobile terminal such as a smartphone or a tablet computer, or another terminal on
which operations similar to tapping, sliding, and the like can be performed. The screen
recording terminal is a terminal that generates a screen recording file, and the playing
terminal is a terminal that plays the screen recording file. Generally, the screen
recording terminal and the playing terminal are two different terminals, but may be
a same terminal. For example, different users separately generate and play a screen
recording file on a same terminal, or a same user uses a same terminal to demonstrate
a process of a same operation for different users.
[0026] For example, FIG. 1 shows a change of a possible display interface of a playing terminal
when different operations are performed. In the display interface, a user may obtain,
by performing a tapping operation, a screen recording file sent by another user, a
screen recording file locally stored in the playing terminal, or a screen recording
file obtained by the playing terminal from a database or a network side device over
a network or the like. The tapping operation may be specifically tapping, double tapping,
a tapping operation performed at a specific frequency and/or for a specific quantity
of times, and/or a tapping operation with a specific pressing force. This is not limited
herein. In addition, a manner of obtaining the screen recording file is not limited
to the tapping operation, and may be another implementation such as dragging or sliding.
This is not limited herein. Subsequently, a dialog box may pop up and/or a prompt
tone may be played in the display interface, to query the user whether an intelligent
playback function needs to be enabled. FIG. 1 shows only a case in which a dialog
box pops up. If the playing terminal receives an instruction that the user attempts
to perform intelligent playback, for example, as shown in FIG. 1, in the pop-up dialog
box, the user triggers the intelligent playback function by performing a tapping operation,
when actual resolution of the screen recording file is the same as resolution of the
playing terminal, the playing terminal may perform event content of at least one input
event, that is, at least one operation recorded in the screen recording file, to complete
an intelligent playback process of a part or all of the screen recording file.
[0027] It should be noted that, the foregoing implementation is merely a possible implementation,
and a presentation status of the display interface of the playing terminal is also
one of examples. Another possible display manner of the playing terminal is further
presented below, but a display manner is not limited to the display manners mentioned
in the embodiments of the present invention.
[0028] An embodiment of the present invention provides a screencast recording method, and
the method is applied to a screen recording terminal. As shown in FIG. 2, the method
specifically includes the following steps.
[0029] Step 101: Obtain an operation performed by a screen recording user on the screen
recording terminal, and determine screen content and event content that are corresponding
to the operation.
[0030] The event content includes at least content used to indicate a manner of generating
the operation.
[0031] In a process in which the user performs an operation on the screen recording terminal,
each time the user performs an operation, the screen recording terminal obtains an
action performed by the user when a current operation is triggered, that is, the event
content, and also obtains a display status of a current interface, that is, the screen
content. Further details of the event content and the screen content are described
below, and details are not described herein again.
[0032] Step 102: Generate video data and a screen recording operation intelligent playback
part based on the screen content and the event content.
[0033] The screen recording operation intelligent playback part includes at least corresponding
screen content and event content that are used to indicate all operations in the video
data.
[0034] Step 103: Generate a screen recording file that includes the video data and the screen
recording operation intelligent playback part.
[0035] As shown in FIG. 3, FIG. 3 is a schematic diagram of composition of a screen recording
file and a schematic diagram of composition of a screen recording operation intelligent
playback part in the screen recording file. It should be noted that content shown
in FIG. 3 is merely a possible implementation, and all parts of content included in
the screen recording file or the screen recording operation intelligent playback part
may be arranged in a manner shown in FIG. 3, or may be arranged in another combination
manner. A location of each part is not limited in this embodiment of the present invention.
[0036] In FIG. 3, the screen recording file includes not only the video data and the screen
recording operation intelligent playback part, but also media meta information. The
media meta information is used to record information received by an audio information
collection device such as a microphone (microphone, MIC) when the screen recording
terminal records a screencast. The video data is used to record content presented
on a screen of the screen recording terminal during screencast recording. The screen
recording operation intelligent playback part is used to record each input event and
screen content corresponding to the input event, and the input event includes at least
event content. For example, as shown in FIG. 4, FIG. 4 is a schematic diagram of a
display interface of a screen recording terminal when a user performs screen recording
on the screen recording terminal. In an operation procedure shown in FIG. 4, an interface
initially displayed on the screen recording terminal is a display interface of WeChat.
The user taps "+" on an upper right corner of the display interface, then a menu bar
pops up, and the user taps "Add Contacts". In the process, there are two user operations:
tapping "+" and tapping "Add Contacts". In an example of the screen recording file
shown in FIG. 3, the screen recording operation intelligent playback part includes
two input events: a first input event and a second input event. The first input event
is generated before the second input event, and both event content of the first input
event and event content of the second input event are tapping operations. Screen content
corresponding to the first input event is a main display interface of WeChat, for
example, a display interface shown on the left of FIG. 4. Screen content corresponding
to the second input event is a display interface in which the menu bar pops up, for
example, a display interface shown on the right of FIG. 4.
[0037] In addition, in this embodiment of the present invention, the input event may further
include a voice auxiliary bit, and a current terminal may determine, based on the
voice auxiliary bit identifier, whether to play audio corresponding to the event content.
For a specific implementation, refer to the following description, and details are
not described herein again.
[0038] When a screen recording file generated by using the foregoing implementation is played
on a playing terminal, not only a playing mode in which a user watches the screen
recording file in the background can be used, but also the playing terminal can directly
complete, for the user, some or all input events recorded in the screen recording
file. In the screen recording file generated by using the solution provided in this
embodiment of the present invention, event content of each input event and corresponding
screen content on which the input event is generated can be recorded, so that during
subsequent intelligent playback, all operations performed during screen recording
can be effectively restored.
[0039] Because a user who uses intelligent playback may be a user with a visual impairment,
in an implementation of this embodiment of the present invention, as shown in FIG.
3, the screen recording operation intelligent playback part further includes a voice
auxiliary bit identifier, to help the user know operation steps in the entire intelligent
playback process. If audio exists for an operation corresponding to the voice auxiliary
bit identifier in a process of generating the operation, the voice auxiliary bit identifier
is set to be valid. For example, if a first input event has corresponding audio, to
be specific, the user describes or explains the first input event, or the operation
triggers the screen recording terminal to generate a piece of audio, a voice auxiliary
bit of the first input event may be set to be valid, to effectively restore the audio
in an intelligent playback process. It should be noted that, because generally only
a minority of input events in the screen recording operation intelligent playback
part have corresponding audio, in this embodiment of the present invention, the voice
auxiliary bit is invalid by default. If a voice auxiliary bit is required, the voice
auxiliary bit is set during generation of a corresponding operation.
[0040] After the screen recording file is generated on the screen recording terminal, once
the user needs the screen recording file, the user may obtain the screen recording
file over a network or the like, and then run the screen recording file on the playing
terminal based on a requirement of the user. An embodiment of the present invention
provides a screencast playing method, and the method is applied to a playing terminal.
As shown in FIG. 5, the method specifically includes the following steps.
[0041] Step 201: Obtain a screen recording file.
[0042] The screen recording file includes at least video data and a screen recording operation
intelligent playback part, the screen recording operation intelligent playback part
includes at least corresponding screen content and event content that are used to
indicate at least one operation in the video data, and the event content includes
at least content used to indicate a manner of generating the at least one operation.
[0043] Step 202: Receive an intelligent playback instruction.
[0044] The intelligent playback instruction is used to trigger playing of the screen recording
operation intelligent playback part and performing of the at least one operation on
the playing terminal.
[0045] Once the intelligent playback instruction is received, regardless of whether a piece
of video data has been currently played, or no content in the screen recording file
is currently played, intelligent playback is performed on the screen recording operation
intelligent playback part from a to-be-generated input event. This means that intelligent
playback may be performed starting from a first input event or starting from any one
of a second input event to a last input event. A specific input event starting from
which intelligent playback is performed mainly depends on a time of receiving the
intelligent playback instruction. Alternatively, a user or an operator may set in
advance that intelligent playback is performed starting from which input event after
the intelligent playback instruction is received, and a specific occasion for performing
intelligent playback is not limited herein.
[0046] If the screen recording file is a file sent by a screen recording terminal to the
playing terminal, the playing terminal can prompt, in a form of a suspend button,
in a manner of a composite key, or in another form that can be used to select a screen
recording file sent from the screen recording terminal, the user to enter the intelligent
playback instruction. Certainly, the playing terminal may provide no prompt for the
user, and the user independently enters the intelligent playback instruction, to trigger
a playback process of the screen recording file.
[0047] For example, FIG. 6 shows an implementation in which a playing terminal presents,
in a form of a suspend button, options for playing a screen recording file. When the
user touches an area that is in the suspend button and that indicates playing of the
screen recording file, a dialog box for selecting a playing mode by the user pops
up in a display interface of the playing terminal. The user may choose, by performing
a tapping operation, to perform common playback of the screen recording file in a
conventional manner, or may use an implementation mentioned in this embodiment of
the present invention, that is, intelligent playback. If the user attempts to select
the common playback, the pop-up dialog box may further provide a plurality of playing
software options for the user to select. If the user initially selects the common
playback, and the user has completed operations corresponding to several initial input
events, the user may switch a playing mode during the common playback, to be specific,
switch the common playback to the intelligent playback. For example, the user may
still complete the switching function by using the options in the suspend button.
[0048] Step 203: Perform at least one operation according to the intelligent playback instruction.
[0049] In this embodiment of the present invention, event content of at least one input
event in the obtained screen recording file may be performed after the intelligent
playback instruction is received. It can be learned that a process of performing the
event content of the at least one input event is performed by the playing terminal
based on the screen recording file, while the user does not need to manually complete
each operation step presented in a recorded video after watching the video. In this
way, a manual operation process of the user can be simplified, thereby resolving a
problem of a misoperation caused by a manual operation performed by the user.
[0050] In an implementation of this embodiment of the present invention, when resolution
of the playing terminal is different from resolution of the screen recording terminal,
screen adaptation may be further performed, to increase a success rate of performing
a set of operation procedures by the playing terminal through intelligent playback.
Therefore, based on the implementation shown in FIG. 5, an implementation shown in
FIG. 7 may be further implemented. After step 202 of receiving the intelligent playback
instruction is performed, step 204 and step 205 may be further performed, and step
203 of performing the at least one operation according to the intelligent playback
instruction may be specifically implemented as step 2031.
[0051] Step 204: If resolution of the playing terminal is different from resolution of a
screen recording terminal, convert coordinates of a screen touching operation generated
on the screen recording terminal in video data into specified coordinates on the playing
terminal.
[0052] The screen recording terminal is a terminal that generates the screen recording file.
[0053] If the screen recording file includes the resolution of the screen recording terminal,
the playing terminal may directly obtain the resolution of the screen recording terminal
from the screen recording file, or the playing terminal may determine the resolution
of the screen recording terminal based on a resolution status of the video data in
the screen recording file, and then locally obtain the resolution of the playing terminal.
It should be noted that a manner of obtaining the resolution is not limited to the
foregoing implementation, and may be another means that can be used to extract resolution
information. This is not limited herein. In addition, the resolution may be specifically
screen resolution of the playing terminal and screen resolution of the screen recording
terminal.
[0054] In this embodiment of the present invention, the display interface of the playing
terminal and a display interface of the screen recording terminal may be separately
used as coordinate planes, and respective coordinate systems are established on the
two coordinate planes. After the two coordinate systems are established, the playing
terminal may map a relationship between coordinates of a generated screen touching
operation and a coordinate system corresponding to the screen recording terminal to
a relationship between coordinates of a screen touching operation that needs to be
generated in the display interface of the playing terminal and a coordinate system
corresponding to the playing terminal, and determine, based on the relationship and
the coordinate system corresponding to the playing terminal, the coordinates of the
screen touching operation that needs to be generated in the display interface of the
playing terminal, to complete the foregoing coordinate conversion process, that is,
obtain the specified coordinates.
[0055] Although the resolution of the screen recording terminal is different from the resolution
of the playing terminal, coordinate systems may be established on different terminals
in a same manner, to improve accuracy of screen recording playback. For example, as
shown in FIG. 8, for the screen recording terminal, a lower left corner of a screen
is used as an origin, an x-axis is established along a bottom side of the screen,
and a left-to-right direction of the bottom side is used as a positive direction of
the x-axis. Likewise, a y-axis is established along a left side of the screen, and
a bottom-to-top direction of the left side is used as a positive direction of the
y-axis. Then the left side is divided into 10 equal parts, and the bottom side is
divided into five equal parts, so that a rectangular coordinate system of the screen
is established based on the screen recording terminal. In a same manner, a rectangular
coordinate system is established on the playing terminal based on a screen of the
playing terminal. As shown in FIG. 8, during screen recording, a valid area corresponding
to a location of the touching operation performed by the user on the screen recording
terminal is a quadrangle area formed after four dashed lines are crossed. It should
be noted that, although the touching operation does not fill the entire quadrangle
area, because of sensitivity of the screen, a corresponding operation can be triggered
provided that the touching operation is generated in an elliptic area in the quadrangle
area. In addition, provided that it is ensured that a location on which a tapping
operation is generated completely falls within the quadrangle area, it can be ensured
that most of the location on which the tapping operation is generated falls within
the elliptic area, thereby triggering a corresponding operation. Therefore, although
unit distances of the respective rectangular coordinate systems of the screen recording
terminal and the playing terminal are different, a corresponding operation may be
accurately triggered provided that screen touching operations are on a same relative
location on the screens. For example, as shown in FIG. 8, in the screen recording
terminal, the quadrangle area is an area formed by using coordinates (1, 9), (1, 7),
(3, 7), and (3, 9) that are used as vertices, and therefore, in the playing terminal,
a corresponding quadrangle area is also an area formed by using coordinates (1, 9),
(1, 7), (3, 7), and (3, 9) that are used as vertices. It can be learned that, in FIG.
8, if the location on which the operation is generated is a location, shown on the
playing terminal, on which a tapping operation is generated, functions such as an
interface jump function and a menu pop-up function cannot be successfully triggered
on the playing terminal.
[0056] It should be noted that a manner of establishing the coordinate system is not limited
to the implementation shown in FIG. 8. For example, a location of the origin may be
set on any location on the screen recording terminal, provided that it is ensured
that a relative location relationship between the origin on the screen recording terminal
and an origin on the playing terminal remains unchanged. The relative location relationship
may be measured by using a distance from the origin to each side, or in another manner
that can be used to indicate the relative location relationship. This is not limited
herein. For another example, unit lengths of the coordinate systems located on the
screen recording terminal and the playing terminal may be the same or different. When
the unit lengths are the same, a relative relationship between the two coordinate
systems may be determined with reference to a proportion of sides located on a same
location of the two screens, so that a point on the playing terminal can be determined
based on a corresponding point on the screen recording terminal. When the unit lengths
are different, a case similar to the following case shown in FIG. 8 may occur: quantities
of unit lengths by which the two x-axes are divided are the same and quantities of
unit lengths by which the two y-axes are divided are the same; or it is possible that
quantities of unit lengths by which the two x-axes are divided are different, and
quantities of unit lengths by which the two y-axes are divided are different; or it
is possible that only quantities of segments into which the x-axes are divided are
the same or only quantities of segments into which the y-axes are divided are the
same. However, a manner of reflecting the relative location relationship is consistent
with that of the case in which the unit lengths are the same, and details are not
described herein again. In addition, the coordinate system is not limited only to
the rectangular coordinate system, and may be a coordinate system of another type,
and details are not described one by one herein. In addition, a location may be represented
by using a vector or another form in addition to coordinates.
[0057] It should be noted that, a conversion manner is not limited to the foregoing implementation,
and may be another implementation that can implement the coordinate conversion. This
is not limited herein.
[0058] Step 205: Perform the at least one operation on the playing terminal based on the
specified coordinates.
[0059] Step 2031: If the resolution of the playing terminal is the same as the resolution
of the screen recording terminal, perform the at least one operation according to
the intelligent playback instruction.
[0060] After the coordinate conversion process is completed, event content of each input
event in the screen recording file may be completed on a corresponding location on
the playing terminal, to be specific, within the elliptic area in the display interface
of the playing terminal shown in FIG. 8. In this way, the playing terminal may complete
the event content of the at least one input event in the display interface of the
playing terminal based on the specified coordinates.
[0061] In this embodiment of the present invention, using a screen adaptation manner can
avoid a problem that a corresponding function cannot be triggered because of different
resolution of terminals. In this embodiment of the present invention, for a playing
terminal and a screen recording terminal with same resolution, the event content of
the at least one input event can be directly performed without screen adaption. For
a playing terminal and a screen recording terminal with different resolution, after
screen adaptation is completed, intelligent playback of the screen recording file
can be performed provided that uniform mapping can be successfully performed between
resolution of the playing terminal and resolution of the screen recording terminal.
It can be learned that, in the foregoing implementation, a problem of an inconsistent
operation or a misoperation caused by different resolution of the screen recording
terminal and the playing terminal can be effectively avoided.
[0062] In an implementation of this embodiment of the present invention, there may be one
or more input events. If there are a plurality of input events, operations corresponding
to all of the at least one input event need to be successively performed. Therefore,
based on the implementation shown in FIG. 5 or FIG. 7, for example, based on the implementation
shown in FIG. 5, an implementation shown in FIG. 9 may be further implemented. Step
203 of performing the at least one operation according to the intelligent playback
instruction may be specifically implemented as step 2032.
[0063] Step 2032: If the resolution of the playing terminal is the same as the resolution
of the screen recording terminal, successively perform all of the at least one operation.
[0064] The screen recording file shown in FIG. 3 is used as an example, and successively
performing the event content of the at least one input event is specifically: performing
event content of the first input event on the playing terminal, and after the event
content is performed, performing event content of the second input event; likewise,
after event content of the last input event is performed, or after the playing terminal
receives an instruction for terminating the intelligent playback, stopping a current
operation or stopping the intelligent playback after a current operation is performed.
[0065] Performance of the screen recording terminal and the playing terminal may be different,
and this means that reaction times of the screen recording terminal and the playing
terminal in a process such as an interface jump process or a menu pop-up process are
different. Such a time delay may also cause a misoperation. Therefore, in a process
of performing the at least one operation, an interface matching relationship also
needs to be considered, and a corresponding operation can be further performed only
when the two interfaces are the same. Therefore, based on the implementations shown
in FIG. 5, FIG. 7, and FIG. 9, for example, based on the implementation shown in FIG.
5, an implementation shown in FIG. 10 may be further implemented. Step 203 of performing
the at least one operation according to the intelligent playback instruction may be
specifically implemented as step 301 and step 302.
[0066] Step 301: If current screen content is the same as screen content on which a specified
operation is generated, perform the specified operation.
[0067] Step 302: If the current screen content is different from the screen content on which
the specified operation is generated, perform interface matching until the current
screen content is the same as the screen content on which the specified operation
is generated, and perform the specified operation.
[0068] In this embodiment of the present invention, the specified operation may be a currently
to-be-performed operation, that is, any one of the at least one operation. Before
each input event is performed, it needs to be determined whether screen content during
screen recording is the same as current screen content, and a corresponding operation
is performed only when the screen content during screen recording is the same as the
current screen content.
[0069] In this embodiment of the present invention, in a process of determining whether
a current interface is the same as an interface in which a specified input event is
generated, whether the two interfaces are the same may be determined based on whether
display content of a specified area in the current interface is the same as display
content of the specified area in the interface in which the specified input event
is generated. Therefore, based on the implementation shown in FIG. 10, an implementation
shown in FIG. 11 may be further implemented. Step 302 may be specifically implemented
as step 3021 to step 3023.
[0070] Step 3021: If the current screen content is different from the screen content on
which the specified operation is generated, obtain display content of a specified
area in an interface in which the specified operation is generated. Step 3022: Detect,
based on a specified interval, whether an area that is the same as the display content
exists in the current screen content, and when the area that is the same as the display
content exists, determine that the current screen content is the screen content on
which the specified operation is generated.
[0071] The specified interval may be a preset fixed time interval or a preset irregular
time interval, or detection may be performed in real time. The specified interval
may be set to a relatively long or short time based on a requirement of the user,
and may be specifically preset by the user based on historical data or an empirical
value. For example, when the specified interval is set to a relatively short time,
the foregoing detection process may be considered as real-time monitoring, so as to
reduce a time wasted in a matching process, but this causes excessive resource wastes.
Therefore, the user may choose to set the specified interval to a suitable time length.
[0072] Step 3023: Perform the specified operation.
[0073] For example, as shown in FIG. 12, a display interface of WeChat is used as an example.
Parts circled by dashed-line boxes may be considered as display content of a specified
area in the display interface. If a current interface is the same as the parts circled
by the dashed-line boxes in the interface in which the specified input event is generated,
the current interface is considered as the interface in which the specified input
event is generated. It should be noted that, in this embodiment of the present invention,
content of a fixed user interface in a display interface is usually used as a basis
for comparison. In this case, even if there is a difference between types, models,
or the like of the playing terminal and the screen recording terminal, the foregoing
process of determining whether the interfaces are the same can be completed. In FIG.
12, the parts circled by the dashed-line boxes are content of a fixed user interface
in the display interface of WeChat, that is, content that is presented when the display
interface is displayed on any terminal.
[0074] It can be learned that, when event content of each input event is being performed,
a matching operation needs to be performed, so as to avoid a problem, caused by a
performance difference between terminals, that a time interval between performing
of two adjacent input events on a specified terminal is different from a time interval
between performing of the two adjacent input events on a current terminal, and after
interface matching succeeds, corresponding event content is performed, thereby increasing
a success rate of implementing intelligent playback, and effectively avoiding a problem
such as an intelligent playback failure or intelligent playback termination caused
by a performance difference between two terminals.
[0075] Because the current display interface of the playing terminal may be different from
the interface of the specified input event when intelligent playback is selected,
to quickly determine the interface in which the specified input event is generated,
in an implementation of this embodiment of the present invention, the playing terminal
may find, based on a package name and a class name of an application, the application
that is running or that is not started. After the application is started, the playing
terminal finds a specific display interface in the application based on the class
name, so as to implement a jump to the interface of the specified input event. Therefore,
based on the implementation shown in FIG. 11, an implementation shown in FIG. 13 may
be further implemented. Before step 3021 of obtaining the display content of the specified
area in the interface in which the specified operation is generated is performed,
the playing terminal further needs to jump to the specified interface. Therefore,
step 3021 may be specifically implemented as step 401 to step 405.
[0076] Step 401: If the current screen content is different from the screen content on which
the specified operation is generated, obtain a package name and a class name of an
application corresponding to the specified operation in the screen recording file.
[0077] Step 402: Determine, based on the package name of the application, the application
corresponding to the specified operation, and access the application.
[0078] Step 403: If the screen recording file has permission to access the application,
determine, based on the class name, a specified interface corresponding to the specified
operation, and jump to the specified interface.
[0079] Step 404: If the screen recording file has no permission to access the application,
generate prompt information.
[0080] The prompt information is used to prompt the user to enable the permission to access
the application.
[0081] Step 405: After the screen recording file has the permission to access the application,
determine, based on the class name, the specified interface corresponding to the specified
operation, and jump to the specified interface.
[0082] In this embodiment of the present invention, before starting the entire intelligent
playback process, the playing terminal may first jump to the interface corresponding
to the specified input event, to be specific, jump to the interface in which the specified
operation of the specified input event is generated, that is, the foregoing specified
interface, so that after starting the intelligent playback, the playing terminal can
directly complete the event content of the at least one input event based on content
recorded in the screen recording operation intelligent playback part. Because a user
who uses intelligent playback may be a user with a visual impairment, to help the
user know operation steps in the entire intelligent playback process, in an implementation
of this embodiment of the present invention, the screen recording operation intelligent
playback part further includes a voice auxiliary bit identifier. In a process in which
the playing terminal performs intelligent playback, the playing terminal may choose,
based on information recorded in the voice auxiliary bit, whether to play audio corresponding
to the specified operation that is being performed, and play the audio when the audio
needs to be played. Therefore, based on the implementations shown in FIG. 10, FIG.
11, and FIG. 13, for example, based on the implementation shown in FIG. 10, an implementation
shown in FIG. 14 may be further implemented. After step 202 of receiving the intelligent
playback instruction is performed, step 303 may be further performed.
[0083] Step 303: If a voice auxiliary bit identifier is valid, when the specified operation
is being performed, play audio corresponding to the specified operation.
[0084] For example, if the voice auxiliary bit identifier is 1, it is considered that the
voice auxiliary bit identifier is valid, and when specified event content of a specified
input event is performed, audio corresponding to the specified event content is played,
to notify the user of a currently performed operation. If the voice auxiliary bit
identifier is 0, it is considered that the voice auxiliary bit identifier is invalid,
and only specified event content of a specified input event is performed, that is,
a specified operation is performed, but audio corresponding to the specified operation
is not played.
[0085] It should be noted that, in a process in which the screen recording terminal records
a screencast, the screen recording process may be triggered in a manner such as touching
and holding a power button or a volume button. After the screen recording process
starts, the user may complete a series of operations on the playing terminal to implement
corresponding functions.
[0086] A payment process in WeChat is used as an example. FIG. 15 shows a complete payment
process. When a current interface is the display interface of WeChat, a user taps
a "+" button on an upper right corner of the display interface, selects a "Money"
option, and then touches an area used to represent a payment operation after a jump
to a payment/money receiving interface is performed, and then a jump to an interface
for entering a payment password is performed. After a current terminal obtains the
screen recording file and completes an intelligent playback process, a current display
interface is also an interface for entering a payment password.
[0087] It should be noted that after performing the at least one operation, based on a requirement
of the user, the playing terminal may jump from a current interface to a display interface
existing before the at least one operation is performed. In the example of FIG. 15,
after the payment operation is completed, a direct jump from the payment interface
to the main interface of WeChat is performed.
[0088] It may be understood that to implement the foregoing functions, the screen recording
terminal and the playing terminal include corresponding hardware structures and/or
software structures for performing the functions. A person skilled in the art should
easily be aware that, in combination with the examples described in the embodiments
disclosed in this specification, units and algorithm steps may be implemented by hardware
or a combination of hardware and computer software in the embodiments of the present
invention. Whether a function is performed by hardware or hardware driven by computer
software depends on particular applications and design constraints of the technical
solutions. A person skilled in the art may use different methods to implement the
described functions for each particular application, but it should not be considered
that the implementation goes beyond the scope of the embodiments of the present invention.
[0089] In the embodiments of the present invention, functional modules of the screen recording
terminal, the playing terminal, and the like may be obtained through division based
on the foregoing method examples. For example, each functional module may be obtained
through division based on each corresponding function, or two or more functions may
be integrated into one processing module. The integrated module may be implemented
in a form of hardware, or may be implemented in a form of a software functional module.
It should be noted that the module division in the embodiments of the present invention
is an example, and is merely logical function division, and there may be another division
manner in actual implementation.
[0090] When each functional module may be obtained through division based on each corresponding
function, FIG. 16 is a possible schematic structural diagram of a screen recording
terminal in the foregoing embodiments. A screen recording terminal 50 includes an
obtaining module 51, a determining module 52, a generation module 53, and a setting
module 54. The obtaining module 51 is configured to support the screen recording terminal
50 in performing the obtaining operation in step 101 in FIG. 2. The determining module
52 is configured to support the screen recording terminal 50 in performing the determining
operation in step 101 in FIG. 2. The generation module 53 is configured to support
the screen recording terminal 50 in performing step 102 and step 103 in FIG. 2. The
setting module 54 is configured to support a process in which the screen recording
terminal 50 gradually generates a screen recording operation intelligent playback
part and a screen recording file. All related content of each step in the foregoing
method embodiments may be cited in function description of a corresponding functional
module, and details are not described herein.
[0091] FIG. 17 is a possible schematic structural diagram of a playing terminal in the foregoing
embodiments. A playing terminal 60 includes an obtaining module 61, a receiving module
62, an execution module 63, a conversion module 64, an access module 65, a generation
module 66, a playing module 67, and a restoration module 68. The obtaining module
61 is configured to support the playing terminal 60 in performing step 201 in FIG.
5, FIG. 7, FIG. 9, FIG. 10, FIG. 11, FIG. 13, and FIG. 14, step 3021 in FIG. 11, and
step 401 in FIG. 13. The receiving module 62 is configured to support the playing
terminal 60 in performing step 202 in FIG. 5, FIG. 7, FIG. 9, FIG. 10, FIG. 11, FIG.
13, and FIG. 14. The execution module 63 is configured to support the playing terminal
60 in performing step 203 in FIG. 5, step 2031 and step 205 in FIG. 7, step 2032 in
FIG. 9, step 301 and step 302 in FIG. 10, step 301 and step 3021 to step 3023 in FIG.
11, step 301, step 403, step 405, step 3022, and step 3033 in FIG. 13, and step 301
and step 302 in FIG. 14. The conversion module 64 is configured to support the playing
terminal 60 in performing step 204 in FIG. 7. The access module 65 is configured to
support the playing terminal 60 in performing step 402 in FIG. 13. The generation
module 66 is configured to support the playing terminal 60 in performing step 404
in FIG. 13. The playing module 67 is configured to support the playing terminal 60
in performing step 303 in FIG. 14. The restoration module 68 is configured to support
the playing terminal 60 in jumping, after at least one operation is performed, to
an interface existing before the at least one operation is performed. All related
content of each step in the foregoing method embodiments may be cited in function
description of a corresponding functional module, and details are not described herein.
[0092] When an integrated unit is used, FIG. 18 is a possible schematic structural diagram
of a screen recording terminal 70 in the foregoing embodiments. The screen recording
terminal 70 includes a communications unit 71 and a processing unit 72. The communications
unit 71 is configured to support the screen recording terminal 70 in performing the
obtaining operation in step 101 in FIG. 2, and is further configured to support communication
between the screen recording terminal 70 and another device such as a playing terminal,
or is configured to collect a corresponding instruction or the like triggered by a
user. The processing unit 72 is configured to support the screen recording terminal
70 in performing the determining operation in step 101, step 102, and step 103 in
FIG. 2, and support a process of gradually generating a screen recording operation
intelligent playback part and a screen recording file, and/or is configured to perform
another process of the technology described in this specification. In addition, the
screen recording terminal 70 may further include a storage unit 73, configured to
store program code and data of a base station.
[0093] FIG. 19 is a possible schematic structural diagram of a playing terminal 80 in the
foregoing embodiments. The playing terminal 80 includes a communications unit 81 and
a processing unit 82. The communications unit 81 is configured to support the playing
terminal 80 in performing step 201 and step 202 in FIG. 5, FIG. 6, FIG. 9, FIG. 10,
FIG. 11, FIG. 13, and FIG. 14, step 3021 in FIG. 11, and step 401 in FIG. 13, and
is further configured to support communication between the playing terminal 80 and
another device such as a screen recording terminal, or is configured to collect a
corresponding instruction or the like triggered by a user. The processing unit 82
is configured to support the playing terminal 80 in performing step 203 in FIG. 5,
step 2031, step 203, and step 205 in FIG. 7, step 2032 in FIG. 9, step 301 in FIG.
10, FIG. 11, and FIG. 13, step 302 in FIG. 10 and FIG. 14, step 3022 and step 3023
in FIG. 11 and FIG. 13, step 402 to step 405 in FIG. 13, and step 303 in FIG. 14,
and support a process of gradually generating a screen recording operation intelligent
playback part and a screen recording file, and/or is configured to perform another
process of the technology described in this specification. In addition, the playing
terminal 80 may further include a storage unit 83, configured to store program code
and data of a base station.
[0094] The processing units in the screen recording terminal and the playing terminal each
may be a processor or a controller, for example, may be a central processing unit
(Central Processing Unit, CPU), a general-purpose processor, a digital signal processor
(Digital Signal Processor, DSP), an application-specific integrated circuit (Application-Specific
Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate
Array, FPGA) or another programmable logic component, a transistor logic component,
a hardware component, or any combination thereof. The processing units may implement
or execute various example logical blocks, units, and circuits described with reference
to content disclosed in the embodiments of the present invention. The processor may
be a combination of processors implementing a computing function, for example, a combination
of one or more microprocessors, or a combination of a DSP and a microprocessor. The
communications unit in the screen recording terminal and the playing terminal each
may be implemented as a transceiver, a transceiver circuit, a communications interface,
or the like. The storage units in the screen recording terminal and the playing terminal
each may be implemented as a memory.
[0095] For the screen recording terminal, if a function of the communications unit 71 is
implemented by a transceiver, a function of the processing unit 72 is implemented
by a processor, and a function of the storage unit 73 is implemented by a memory,
a screen recording terminal 100 in an embodiment of the present invention may be shown
in FIG. 20. As shown in FIG. 20, the screen recording terminal 100 includes a processor
11, a transceiver 12, a memory 13, and a bus 14. The processor 11, the transceiver
12, and the memory 13 are connected to each other by using the bus 14.
[0096] For the playing terminal, if a function of the communications unit 81 is implemented
by a transceiver, a function of the processing unit 82 is implemented by a processor,
and a function of the storage unit 83 is implemented by a memory, a playing terminal
200 in an embodiment of the present invention may be shown in FIG. 21. As shown in
FIG. 21, the playing terminal 200 includes a processor 21, a transceiver 22, a memory
23, and a bus 24. The processor 21, the transceiver 22, and the memory 23 are connected
to each other by using the bus 24.
[0097] The bus 14 and the bus 24 each may be a Peripheral Component Interconnect (Peripheral
Component Interconnect, PCI) bus, an extended industry standard architecture (Extended
Industry Standard Architecture, EISA) bus, or the like. The bus may be classified
into an address bus, a data bus, a control bus, and the like. For ease of indication,
the bus is indicated by using only one bold line in FIG. 20 and FIG. 21. However,
it does not indicate that there is only one bus or only one type of bus.
[0098] The methods or algorithm steps described with reference to the content disclosed
in the embodiments of the present invention may be implemented in a hardware manner,
or may be implemented in a manner of executing a software instruction by a processor.
The software instruction may include a corresponding software module. The software
module may be stored in a random access memory (Random Access Memory, RAM), a flash
memory, a read-only memory (Read-Only Memory, ROM), an erasable programmable read
only memory (Erasable Programmable ROM, EPROM), an electrically erasable programmable
read only memory (Electrically EPROM, EEPROM), a register, a hard disk, a removable
hard disk, a compact disc read-only memory (CD-ROM), or a storage medium in any other
forms well-known in the art. An example storage medium is coupled to the processor,
so that the processor can read information from the storage medium, and can write
information into the storage medium. Certainly, the storage medium may be a part of
the processor. Alternatively, the processor and the storage medium may exist in a
core network interface device as discrete components.
[0099] A person skilled in the art should be aware that in one or more of the foregoing
examples, the functions described in the embodiments of the present invention may
be implemented by using hardware, software, firmware, or any combination thereof.
When the embodiments are implemented by software, these functions may be stored in
a computer-readable medium or transmitted as one or more instructions or code in the
computer-readable medium. The computer-readable medium includes a computer storage
medium and a communications medium, where the communications medium includes any medium
that enables a computer program to be transmitted from one place to another. The storage
medium may be any available medium accessible to a general-purpose or dedicated computer.
The objectives, technical solutions, and beneficial effects of the embodiments of
the present invention are further described in detail in the foregoing specific embodiments.
It should be understood that the foregoing descriptions are merely specific implementations
of the present invention, but are not intended to limit the protection scope of the
present invention. Any modification, equivalent replacement, or improvement made based
on the technical solutions in the embodiments of the present invention shall fall
within the protection scope of the embodiments of the present invention.
[0100] Further embodiments of the present invention are provided in the following. It should
be noted that the numbering used in the following section does not necessarily need
to comply with the numbering used in the previous sections.
Embodiment 1. A screencast recording method, applied to a screen recording terminal,
and comprising:
obtaining an operation performed by a screen recording user on the screen recording
terminal, and determining screen content and event content that are corresponding
to the operation, wherein the event content comprises at least content used to indicate
a manner of generating the operation;
generating video data and a screen recording operation intelligent playback part based
on the screen content and the event content, wherein the screen recording operation
intelligent playback part comprises at least corresponding screen content and event
content that are used to indicate all operations in the video data; and
generating a screen recording file that comprises the video data and the screen recording
operation intelligent playback part.
Embodiment 2. The method according to Embodiment 1, wherein the screen recording operation
intelligent playback part further comprises a voice auxiliary bit identifier, and
the method further comprises:
if audio exists for an operation corresponding to the voice auxiliary bit identifier
in a process of generating the operation, setting the voice auxiliary bit identifier
to be valid.
Embodiment 3. A screencast playing method, applied to a playing terminal, and comprising:
obtaining a screen recording file, wherein the screen recording file comprises at
least video data and a screen recording operation intelligent playback part, the screen
recording operation intelligent playback part comprises at least corresponding screen
content and event content that are used to indicate at least one operation in the
video data, and the event content comprises at least content used to indicate a manner
of generating the at least one operation;
receiving an intelligent playback instruction, wherein the intelligent playback instruction
is used to trigger playing of the screen recording operation intelligent playback
part and performing of the at least one operation on the playing terminal; and
performing the at least one operation according to the intelligent playback instruction.
Embodiment 4. The method according to Embodiment 3, after the receiving an intelligent
playback instruction, further comprising:
if resolution of the playing terminal is different from resolution of a screen recording
terminal, converting coordinates of a screen touching operation generated on the screen
recording terminal in the video data into specified coordinates on the playing terminal,
wherein the screen recording terminal is a terminal that generates the screen recording
file; and
performing the at least one operation on the playing terminal based on the specified
coordinates.
Embodiment 5. The method according to Embodiment 3 or 4, wherein the performing the
at least one operation specifically comprises:
if the resolution of the playing terminal is the same as the resolution of the screen
recording terminal, successively performing all of the at least one operation.
Embodiment 6. The method according to any one of Embodiments 3 to 5, wherein the performing
the at least one operation specifically comprises:
if current screen content is the same as screen content on which a specified operation
is generated, performing the specified operation; or
if the current screen content is different from the screen content on which the specified
operation is generated, performing interface matching until the current screen content
is the same as the screen content on which the specified operation is generated, and
performing the specified operation.
Embodiment 7. The method according to Embodiment 6, wherein the performing interface
matching until the current screen content is the same as the screen content on which
the specified operation is generated specifically comprises:
obtaining display content of a specified area in an interface in which the specified
operation is generated; and
detecting, based on a specified interval, whether an area that is the same as the
display content exists in the current screen content, and when the area that is the
same as the display content exists, determining that the current screen content is
the screen content on which the specified operation is generated.
Embodiment 8. The method according to Embodiment 7, before the obtaining display content
of a specified area in an interface in which the specified operation is generated,
further comprising:
obtaining a package name and a class name of an application corresponding to the specified
operation in the screen recording file;
determining, based on the package name of the application, the application corresponding
to the specified operation, and accessing the application; and
if the screen recording file has permission to access the application, determining,
based on the class name, a specified interface corresponding to the specified operation,
and jumping to the specified interface.
Embodiment 9. The method according to Embodiment 8, after the determining, based on
the package name of the application, the application corresponding to the specified
operation, and accessing the application, further comprising:
if the screen recording file has no permission to access the application, generating
prompt information, wherein the prompt information is used to prompt a user to enable
the permission to access the application; and
after the screen recording file has the permission to access the application, determining,
based on the class name, the specified interface corresponding to the specified operation,
and jumping to the specified interface.
Embodiment 10. The method according to any one of Embodiments 6 to 9, wherein the
screen recording operation intelligent playback part further comprises a voice auxiliary
bit identifier, and when the specified operation is being performed, the method further
comprises:
if the voice auxiliary bit identifier is valid, playing audio corresponding to the
specified operation.
Embodiment 11. The method according to any one of Embodiments 3 to 9, after the performing
the at least one operation, further comprising:
jumping from a current interface to a display interface existing before the at least
one operation is performed.
Embodiment 12. A screen recording terminal, comprising:
an obtaining module, configured to: obtain an operation performed by a screen recording
user on the screen recording terminal, and determine, by using a determining module,
screen content and event content that are corresponding to the operation obtained
by the obtaining module, wherein the event content comprises at least content used
to indicate a manner of generating the operation; and
a generation module, configured to generate video data and a screen recording operation
intelligent playback part based on the screen content and the event content that are
determined by the determining module, wherein the screen recording operation intelligent
playback part comprises at least corresponding screen content and event content that
are used to indicate all operations in the video data, wherein
the generation module is further configured to generate a screen recording file that
comprises the video data and the screen recording operation intelligent playback part.
Embodiment 13. The screen recording terminal according to Embodiment 12, wherein the
screen recording operation intelligent playback part further comprises a voice auxiliary
bit identifier, and the screen recording terminal further comprises:
a setting module, configured to: if audio exists for an operation corresponding to
the voice auxiliary bit identifier in a process of generating the operation, set the
voice auxiliary bit identifier to be valid.
Embodiment 14. A playing terminal, comprising:
an obtaining module, configured to obtain a screen recording file, wherein the screen
recording file comprises at least video data and a screen recording operation intelligent
playback part, the screen recording operation intelligent playback part comprises
at least corresponding screen content and event content that are used to indicate
at least one operation in the video data, and the event content comprises at least
content used to indicate a manner of generating the at least one operation;
a receiving module, configured to receive an intelligent playback instruction, wherein
the intelligent playback instruction is used to trigger playing of the screen recording
operation intelligent playback part that is obtained by the obtaining module and performing
of the at least one operation on the playing terminal; and
an execution module, configured to perform the at least one operation according to
the intelligent playback instruction received by the receiving module.
Embodiment 15. The playing terminal according to Embodiment 14, further comprising:
a conversion module, configured to: if resolution of the playing terminal is different
from resolution of a screen recording terminal, convert coordinates of a screen touching
operation generated on the screen recording terminal in the video data into specified
coordinates on the playing terminal, wherein the screen recording terminal is a terminal
that generates the screen recording file; wherein
the execution module is further configured to perform the at least one operation on
the playing terminal based on the specified coordinates.
Embodiment 16. The playing terminal according to Embodiment 14 or 15, wherein the
execution module is specifically configured to: if the resolution of the playing terminal
is the same as the resolution of the screen recording terminal, successively perform
all of the at least one operation.
Embodiment 17. The playing terminal according to any one of Embodiments 14 to 16,
wherein the execution module is specifically configured to:
if current screen content is the same as screen content on which a specified operation
is generated, perform the specified operation; or
if the current screen content is different from the screen content on which the specified
operation is generated, perform interface matching until the current screen content
is the same as the screen content on which the specified operation is generated, and
perform the specified operation.
Embodiment 18. The playing terminal according to Embodiment 17, wherein the execution
module is specifically configured to:
obtain display content of a specified area in an interface in which the specified
operation is generated; and
detect, based on a specified interval, whether an area that is the same as the display
content exists in the current screen content, and when the area that is the same as
the display content exists, determine that the current screen content is the screen
content on which the specified operation is generated.
Embodiment 19. The playing terminal according to Embodiment 18, wherein the obtaining
module is further configured to obtain a package name and a class name of an application
corresponding to the specified operation in the screen recording file, and the playing
terminal further comprises:
an access module, configured to: determine, based on the package name that is of the
application and that is obtained by the obtaining module, the application corresponding
to the specified operation, and access the application; wherein
the execution module is further configured to: if the screen recording file has permission
to access the application, determine, based on the class name, a specified interface
corresponding to the specified operation, and jump to the specified interface.
Embodiment 20. The playing terminal according to Embodiment 19, further comprising:
a generation module, configured to: if the screen recording file has no permission
to access the application, generate prompt information, wherein the prompt information
is used to prompt a user to enable the permission to access the application; wherein
the execution module is further configured to: after the screen recording file has
the permission to access the application, determine, based on the class name, the
specified interface corresponding to the specified operation, and jump to the specified
interface.
Embodiment 21. The playing terminal according to any one of Embodiments 17 to 20,
wherein the screen recording operation intelligent playback part further comprises
a voice auxiliary bit identifier, and the playing terminal further comprises:
a playing module, configured to: if the voice auxiliary bit identifier is valid, play
audio corresponding to the specified operation.
Embodiment 22. The playing terminal according to any one of Embodiments 14 to 20,
further comprising:
a restoration module, configured to jump from a current interface to a display interface
existing before the at least one operation is performed.