(19)
(11)EP 2 946 330 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
16.05.2018 Bulletin 2018/20

(21)Application number: 14740716.7

(22)Date of filing:  15.01.2014
(51)International Patent Classification (IPC): 
G06F 21/51(2013.01)
G06F 21/55(2013.01)
G06F 21/57(2013.01)
G06F 21/54(2013.01)
G06F 21/56(2013.01)
(86)International application number:
PCT/IL2014/050033
(87)International publication number:
WO 2014/111922 (24.07.2014 Gazette  2014/30)

(54)

METHOD AND SYSTEM FOR PROTECTING COMPUTERIZED SYSTEMS FROM MALICIOUS CODE

VERFAHREN UND SYSTEM ZUM SCHUTZ COMPUTERISIERTE SYSTEME VOR BÖSARTIGEM CODE

PROCÉDÉ ET SYSTÈME POUR PROTÉGER DES SYSTÈMES INFORMATIQUES CONTRE DU CODE MALVEILLANT


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 21.01.2013 IL 22435713

(43)Date of publication of application:
25.11.2015 Bulletin 2015/48

(73)Proprietor: Morphisec Information, Security 2014 Ltd.
84894 Beer Sheva (IL)

(72)Inventors:
  • GURI, Mordehai
    7170656 Modi'in (IL)
  • ELOVICI, Yuval
    7986400 D.N. Lachish (IL)
  • KEDMA, Gabi
    8496500 Omer (IL)

(74)Representative: Delumeau, François Guy et al
Cabinet Beau de Loménie 158, rue de l'Université
75340 Paris Cedex 07
75340 Paris Cedex 07 (FR)


(56)References cited: : 
US-A1- 2003 172 109
US-A1- 2004 168 173
US-A1- 2005 188 171
US-A1- 2012 159 630
US-A1- 2012 210 443
US-B1- 7 913 092
US-A1- 2003 237 028
US-A1- 2004 237 071
US-A1- 2007 220 601
US-A1- 2012 159 630
US-B1- 7 913 092
  
      
    Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


    Description

    Field of the Invention



    [0001] The invention relates to the field of information security. More particularly, the invention provides a system and method for protecting a computerized system from malicious code. More specifically, the invention modifies essential elements within the programing interface of the operating system or the instruction set for preventing the expected operation of any unauthorized code including malicious software. Any code which is expected to run on the operating system must be appropriately modified, otherwise, it will fail or will cause an alarm.

    Background of the Invention



    [0002] The present art provides several manners by which a computerized system (including mobile devices, such as smart phones) can be protected from a malicious code:

    a. Preventing unauthorized code (hereinafter, also referred to as "program" or "application") from entering the system, by checking its validity (such as its signature, its originating source, etc.);

    b. Performing a static analysis of the program to ensure that it does not include a malicious code;

    c. Shielding the operating system from being exploited through known vulnerabilities by constantly patching such vulnerabilities as soon as they are exposed.

    d. Monitoring the behavior of suspicious programs while they run on the system or on a sandbox.



    [0003] For instance document US 2012/159630 A1 proposes the verification of program execution integrity and suggests storing an integrity marker which is created to indicate the integrity of a program. However, the abovementioned prior art means for the system protection suffer from at least one of the following flaws:
    1. a. They require a prior knowledge by the protector either with respect to the code, to its origin, or to its behavior;
    2. b. They require assumptions with respect to normal or anomalous behavior of the protected system.
    3. c. They require prior knowledge of exploitable vulnerabilities, and will not identify a new (hitherto unknown) exploit.
    4. d. They may detect the malicious behavior too late, after a significant damage has already been caused to the system including the protected resources.
    5. e. It is not clear when and how the malicious activity is triggered, furthermore, modern malware use evasion and anti-forensics techniques which severely hinder their detection.
    6. f. A previously certified program may at some stage open the gate for malicious code.
    7. g. Malicious code may operate solely in memory without passing through the file system.


    [0004] The present invention is particularly, but not exclusively, applicable to any operating system whose source code is available for recompilation (Open Source); The concepts of the present invention can also be applied to binary code (Closed Source). Moreover, the present invention is particularly but not exclusively applicable to 'isolated' operating systems which are intended to run special purpose programs and are not designated to run a variety of third-party consumer applications; Yet the concepts of the present invention can be applied to other kinds of operating systems including operating systems for mobile devices.

    [0005] Over the last few years, there have been reports of highly protected operating systems (OS), even isolated ones, that were compromised by malicious programs. Unlike a regular consumer-oriented OS, an isolated OS is designated to run special purpose programs. Malicious exploitation of such operating systems may bear critical consequences. At the same time new kinds of operating system such as Android were also being compromised at an accelerating rate.

    [0006] Open source operating systems (primarily Linux) are widely being adopted in a wide range of domains, from smart phones to High Performance Computing (HPC). The open source operating systems may also be used in isolated systems. It is therefore an object of the present invention to provide a method and system for protecting a computerized system from malicious code, either known or unknown, either on open source systems or on closed source systems.

    [0007] It is an object of the present invention to provide a method and system for protecting a computerized system from malicious code, which overcomes all the above mentioned drawbacks of existing means for detection and prevention.

    [0008] It is another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which does not require any prior knowledge about the malicious program, its structure, its behavior, or its origin.

    [0009] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which does not require any assumption with respect to the normal or anomalous behavior of the protected system.

    [0010] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which does not require prior knowledge of exploitable vulnerabilities.

    [0011] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which can prevent any operation of an unauthorized program, or to route it to operate in a restricted supervised mode.

    [0012] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which is immune to common evasion and anti-forensics techniques.

    [0013] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code which bypasses the standard gate keeping mechanisms of a protected system.

    [0014] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code which operates solely in memory without passing through the file system.

    [0015] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which may either replace conventional protection means, or may cooperate with them.

    [0016] It is still another object of the present invention to provide a method and system for protecting a computerized system from malicious code, which may be easily updated on a periodical basis, and may include random ingredients to thwart a bypass by the attacker.

    [0017] Other objects and advantages of the present invention will become clear as the description proceeds.

    Summary of the Invention



    [0018] The invention relates to a method for providing a computerized system which is protected from malicious programs coming from an external source, the method comprises the steps of: (a) secretly, and in a manner unknown to authors of external programs, modifying one or more essential elements at the protected system in a manner which causes all running programs to fail, unless they are subjected to a compatible modification which enables them to run properly; and (b) modifying each program at the computerized system which is known to be benign in order to comply with said modification of one or more essential elements, thereby to enable it to be executed properly.

    [0019] Preferably, said modifications involve a modification to one or more essential elements at the operating system, and to each benign program.

    [0020] Preferably, when a program that does not comply with said modifications is found, the program is halted or sent to a sandbox, and an alert is raised.

    [0021] Preferably, said modifications involve a modification to an operating system at said system, and wherein said modification to each benign program involves a compatible modification to the instruction set used by the program.

    [0022] Preferably, said modifications involve a modification to an instruction set of a processor at said system, and wherein said modification to each benign program involves a compatible modification to the instruction set used by the program.

    [0023] Preferably, the method of the invention is adapted for a static linking, wherein said modification at the protected system involves modification to at least one service routine and to a wrapper routine in the standard library, and wherein said modification to each of the benign programs is a compatible modification to the signature of the program.

    [0024] Preferably, the method of the invention is adapted for a dynamic linking, wherein said modification at the protected system involves maintaining two copies of the dynamic standard library, a first copy of the dynamic standard library under its original name, and a under a modified name, and wherein said modification to each of the benign programs is a compatible modification to call said modified copy of the dynamic standard library.

    [0025] Preferably, the method further includes a stub to detect programs that do not comply with said modification at the protected system.

    [0026] Preferably, the method is adapted for a dynamic linking, wherein said modification at the protected system involves modification to a wrapper routine in the user mode and to the system call service routing in the kernel mode, and wherein said modification to each of the benign programs is a compatible modification to signatures of one or more system call invocations.

    [0027] Preferably, said modification at the protected system involves modification to the names of one or more methods in a dynamic link library, and wherein each of the benign programs are modified to conform with said modification in said dynamic link library.

    [0028] Preferably, the processor is a physical processor. Alternatively, the processor is a virtual processor.

    [0029] Preferably, said modifications are made on a temporal basis, each time a different subset of essential elements and respective parameters are selected for modification.

    [0030] Preferably, the modification to said program further involves recompilation and or relinking of the program.

    [0031] Preferably, the modification to said operating system further involves recompilation and or relinking of the operating system. The invention is defined by the independent claim.

    Brief Description of the Drawings



    [0032] In the drawings:
    • Fig. 1 shows in conceptual terms the manner by which protection of a conventional system is performed;
    • Fig. 2 shows in conceptual terms the manner by which protection of a computerized system according to the present invention is performed;
    • Fig. 3a illustrates a typical flow of a system call from its invocation at a user mode application, to its final implementation by a kernel mode service routing, in a conventional system, such as Linux;
    • Fig. 3b illustrates a first alternative of the first embodiment of the invention;
    • Fig. 3c illustrates a second alternative of the first embodiment adapted for handling dynamic linking;
    • Fig. 3d illustrates a third alternative of the first embodiment which is adapted to cope with dynamic linking without keeping two copies of the dynamic standard library as required by said second alternative;
    • Fig. 4a describes the typical manner by which an application accesses a dynamic library;
    • Fig. 4b describes the second embodiment of the present invention;
    • Fig. 5a shows the typical manner by which an application accesses a utility DLL;
    • Fig. 5b depicts the modifications made according to the third embodiment;
    • Fig. 6 depicts a fourth embodiment of the present invention, where modifications are made at the level of the instruction set;
    • Fig. 7a depicts a first alternative of a fifth embodiment of the present invention, where modifications are made to a virtual machine; and
    • Fig. 7b depicts a fifth embodiment of the present invention, where modifications are made to a Just in Time (JIT) compiler.

    Detailed Description of Preferred Embodiments



    [0033] As noted above, prior art means for protecting a computerized system from a malicious program suffer from various kinds of drawbacks. As will be shown, the present invention overcomes all said drawbacks.

    [0034] Modern operating systems, whether Open Source or Close Source, are designed with modularity and extensibility as primary guidelines. Standardization of the programing interface is therefore an essential requirement of all operating systems.

    [0035] Some essential elements of the operating system are not expected to be modified, and when such elements are modified, some aspects of said element are traditionally expected to be kept untouched. For example, the set of system calls which are implemented by the operating system can be extended by the addition of a new system call, and the underlying code of an existing system call can be modified to enhance its performance. Yet the signature of an existing system call is traditionally expected to be kept untouched. Said signature includes the number and the types of the arguments (parameters) which are passed to the system call upon invocation, as well as the type of the 'return value' which is returned to the caller when the system call exits.

    [0036] The very nature of modern operating systems prohibits such modifications because they compromise the need for a standard programming interface, which allows convenient development of useful programs, including applications as well as extensions to the operating system itself. Keeping the standard programming interface untouched, with the convenience which is guaranteed by this practice, is a highly attractive feature of any modern operating system.

    [0037] Thus, deviations from the standard programming interface of a given operating system are regularly prohibited, and a developer of a new or existing program has no reason to anticipate any of such modifications. Furthermore, when such modifications (nonstandard deviations from the standard programming interface) occur, a developer of a new or existing program must have direct access to the modified programming interface, including the modified standard libraries.

    [0038] It has been found by the inventors of this application, that the negative effects of said deviations can form an asset when coping with malicious programs. The present invention utilizes such unconventional modifications to the operating system to detect and prevent the operation of malicious programs, where the malware's author does not have access to the OS modifications. On the other hand, useful benign applications are properly modified by a central security authority to comply with the modified operating system, thus allowing them to run properly.

    [0039] The present invention is particularly but not exclusively suited for Android devices. Android's kernel is open source Linux, and its user level applications run on the Dalvik virtual machine, which is also open source. An application which is intended to run on Dalvik is compiled into Dalvik bytecode, which is considerably easier to manipulate than hardware's machine code. Thus, even when a Dalvik application's source code is not provided, the application's bytecode can still be analyzed, manipulated, and/or decompiled in a relatively convenient and safe manner.

    [0040] The following description provides five exemplary embodiments. Even though the concepts of the various embodiments are applicable to various types of operating systems and for various levels of code, for the sake of convenience and more clarity the following first and second embodiments are described in terms of the Linux operating system, while the third embodiment is described in terms of the Windows operating system, and the fourth embodiment is described in terms of the instruction-set at the machine level. The fifth embodiment is described in terms of Java or similar bytecode, where either a Virtual Machine (VM) or a Just In Time (JIT) compiler is applied. Furthermore, the invention as described herein is not limited to any particular level of the computerized system. For example, the modifications may be applied to essential elements of the operating system's user or kernel mode, to a hypervisor, or to the instruction set of the machine, either physical or virtual.

    [0041] Fig. 1 shows in conceptual terms the manner by which protection of a conventional system is performed. Initially, a standard operating system is installed 110 and run 111. When an external program 113 is encountered, the operating system routes the external program (through the so called "valid route" 150) to a "checking program" stage or module 120. The term "external program", refers herein to any new piece of code which originates outside of the running operating system. The "checking program" stage 120 checks in some conventional manner known in the art said external program to determine whether it is a malicious or a benign code. The "check program" stage 120 may also use a reputation knowledge base as a sort of "white list". If the program is found to be benign, the operating system may load the program into memory in executable mode (step 122), and allows it to run (step 123). The check program stage 120, may also monitor the external program while it runs, also in a conventional manner well known in the art. However, if the checking program stage 120 finds the external program to be malicious, the running of the program is aborted in step 121, and additional measures well known in the art may also be taken.

    [0042] As noted, the conventional protection manner of Fig. 1 entirely depends on the "checking program" stage 120, as any bypass of this stage will allow a malicious program to run on the system. More specifically, when the external program 113 somehow succeeds in taking the "invalid rout" 160, it bypasses or evades the "checking program" stage 120, and it can successfully run on the system, with all the damaging consequences associated with such evasion. In general terms, there are various manners (which involve either software or physical measures) by which a program may take the "invalid route" 160. The defending side continuously tries to force an external program to use only the valid route 150, while blocking possibilities to exploit the bypass route 160. On the other hand, attackers continuously and repeatedly try to find ways to bypass or evade the valid route 150 (therefore avoid or mislead the "check program" 120), while using the bypass route 160. When succeeding in taking the invalid route 160, the malicious program can be loaded 122, and run 123, with all the damaging consequences.

    [0043] Fig. 2 shows in conceptual terms the manner by which protection of a computerized system according to the present invention is performed. Initially, a standard operating system is internally modified 210 in a manner which is unknown to authors of external programs, either benign or malicious. As will be described hereinafter, various manners of modifications may be applied at this stage 210. This modification to the operating system is generally intended to form a variant of the operating system which does not allow any external program to run on the modified operating system, unless this external program is subjected to a proper corresponding modification which cannot be foreseen by the external program author. In step 211, the modified variant of the operating system is installed and run 212. It should be noted that both steps 210 and 211 are performed by a central security authority 270, which will be further discussed hereinafter.

    [0044] Any external program 213 which is received at the central security authority 270 through a valid route 250, is subjected to a validation procedure 221. The validation procedure 221 thoroughly verifies that the program is benign. If the external program 220 is found to be malicious or otherwise suspicious, it is dropped 222. Only if the external program 220 is found to be benign, it is subjected to a modification procedure 223. The modification procedure 223 is intended to make the external program be compliant with the operating system as modified in step 210.

    [0045] Following said validation 221 and modification 223 of the external program 213, the central security authority 270 installs 224 the external program as modified in step 223 on said modified operating system. In step 230, the modified external program can be loaded into memory in an executable mode, and run in step 232.

    [0046] Any external program 213 which uses the invalid route 260 by bypassing or evading the central authority 270, and arrives at the "load program" step 230, will fail to run as depicted in step 231, as it was not previously modified to comply with the modified operating system (as modified in step 210). This is in contrast to the prior art system of Fig. 1, in which any external program which succeeds in taking the invalid route 160 will be successfully loaded 122 and run 123.

    [0047] Some types of central security authority are known in previous art. One of the tasks of such prior art central security authorities is to validate external programs (i.e., programs from external origin). However, none of said central authorities perform the modification step 223 to comply with the operating system, as modified in step 210 (which is also performed by the central security authority 270.

    [0048] As previously noted, essential elements within the operating system are modified such that malicious programs that were originally compiled and linked with the original standard OS libraries, will not operate within the modified operating system. Any attempt at running them within the modified operating system will raise an alert to the central security authority, and subsequently may be either terminated or sandboxed. On the other hand, properly modified external programs will properly be loaded and run.

    [0049] In a first embodiment of the invention, said modification is made to the signatures for a given subset of the operating system (OS), i.e., "system calls".

    [0050] Fig. 3a illustrates a typical flow of a system call from its invocation 1101a at a user mode application, to its final implementation by a kernel mode service routing 1202a, in a conventional system, such as Linux. An application running at user mode 1100a initiates a system call invocation 1101a, passing the call in a form of the standard signature of this specific system call, to a wrapper routine 1102a which resides in a standard library such as LIBC or its equivalent. In this context which is well known, the term signature typically refers to a function name, the types, order, and number of its parameters, and the type of the function's return value. The wrapper routine 1102a (also known as library routine) may perform some additional operations, and then it passes the call to the system call handler 1201a at kernel mode 1200a. If the signature of the invoked function does match the signature expected by the wrapper routing 1102a, then the call will fail with unexpected results. In case of static linking, the code will fail to link or even to compile. The system call handler 1201a, residing at kernel mode 1200a receives the call from the wrapper routing 1102a, and dispatches it to the proper system call service routine 1202a, also in kernel mode. Here again, if the signature of the call passed from the handler 1201a does not match the expected signature, then the service routine 1202a will fail with unexpected consequences. Otherwise, in a normal operation when there is no exception, the service routine 1202a performs its assigned task, and returns the requested result along with a code which indicates success. As shown, a wrong signature will cause failure of the operation either at the standard library wrapper routine 1102a (at user mode 1100a) or at the service routine 1202a (at kernel mode).

    [0051] Fig. 3b illustrates a first alternative of the first embodiment of the invention. In this alternative, the signature of at least one service routine 1202b is intentionally modified. Furthermore, the standard library wrapper routine 1102b is also intentionally modified to conform to said modified service routine 1202b, while preserving the application call invocation 1101b. This is particularly applicable to the case of static linking of the application's code with the standard library. More specifically, the wrapper routine 1102b is modified such that when it is called by the invocation 1101b with an original signature, it transforms the call into the signature expected by the modified service routine 1202b. The service routine 1202b is modified such that it verifies that the received signature conforms to the modified form. In the affirmative case, the service routine 1202b proceeds normally. Otherwise, the service routine 1202b issues an alert which is followed by either terminating the caller application (which initiated the system call), or by letting the caller application to proceed under strict supervision. Clearly, the author of a malicious application will not be aware of said modifications, and therefore the malicious application will not be linked with the modified standard library, and will therefore fail upon calling the modified system call. Even if somehow the author of the malicious application will know that a modification was made, he does not have access to the crucial details of the modifications, and therefore his malicious application will fail.

    [0052] As said, this first alternative of the first embodiment is particularly suited to static linking. However, there are many applications that use dynamic linking. In such case of dynamic linking, the standard library's wrapper routine 1102b will be called at runtime dynamically by any application which uses dynamic linking (whether it is malicious or benign), and said wrapper routine 1102b will transform the signature of the calling routine, resulting in the modified system call service routine 1202b being called and operate properly without raising any alert.

    [0053] Fig. 3c illustrates a second alternative 3100 of the first embodiment adapted for handling dynamic linking. In said second alternative, the system keeps two different copies of the dynamic standard library as follows: (a) the original dynamic standard library (such as LIBC) 3202 is kept under its original name unmodified, while (b) a modified copy of the dynamic standard library 3102 (where the signatures are modified as noted above) is also kept under a different name. In addition, benign applications 3101 are modified to call said modified copy 3102 of the dynamic standard library (under its new name) rather than calling the original dynamic standard library 3202 (as note, for example, LIBC). However, in this second alternative the signature of the invocation is not modified within the application 3101. In such an arrangement 3100, at runtime any application 3201 which uses dynamic linking but is not modified to call the modified copy by its new name, will fail. Said failure will occur because the application will call the original, unmodified copy of the dynamic standard library 3202, resulting in submitting a wrong signature to the modified kernel 3203.

    [0054] A third alternative 3200 of the first embodiment which is adapted to cope with dynamic linking without keeping two copies of the dynamic standard library as required by said second alternative, is illustrated in Fig. 3d. The essential difference relative to said first and second alternatives is that the application itself is modified to contain the system call invocation 1101d with a modified signature, which in turn complies with the modified wrapper routine 1102d and with the kernel mode modified service routine 1202d. Normally, this alternative requires recompilation and relinking of the modified application program. Thus, even an application which uses dynamic linking must be modified or else it will fail. In this alternative the verification of the signature can be made preferably by the kernel mode service routine 1202d (as in the previous alternatives), or by the standard library wrapper routine 1202d.

    [0055] As noted above, all the three alternatives of the first embodiment involve modification to the signature of one or more system calls. One example of such modification involves adding an extra parameter to the signature. In order to make it harder for attacker to break the secured system of the invention, the extra parameter may require a unique value adhering to the type of the relevant parameter (for example, a "magic number" in the case of a numeric parameter). The type of the one or more extra parameters and their unique values are also verified by the service routine at the kernel mode.

    [0056] According to a second embodiment of the invention, the essential element which is modified is the dynamic linker of the operating system, and all the applications that access the dynamic linker are also modified to conform with said modification of the dynamic linker. Fig. 4a describes the typical manner by which an application accesses a dynamic library. In typical systems, the application 700a which needs to access a dynamic library 720a, uses the dynamic linker 710a which is provided by the operating system. The dynamic linker 710a loads the dynamic library 720a on behalf of the application 700a.

    [0057] Fig. 4b describes the second embodiment of the present invention. According to the second embodiment, the name of the dynamic linker 710b is modified in a manner unknown to authors of external applications. Furthermore, all the applications are modified to conform to said name modification of the dynamic linker in order to operate normally. External applications that have not been properly modified, will fail in loading dynamic libraries and will not operate. Optionally, the system further comprises a stub dynamic linker 705b which is kept under the original dynamic linker name. Under this option, when an unmodified application tries to use a dynamic library, it tries to use the dynamic linker 710a by its original name. This unmodified application will reach the stub 705b instead. Stub 705b will raise an alert with respect to the invalid operation of the external application.

    [0058] According to a third embodiment of the invention, the essential elements that are modified are the names of one or more methods in a dynamic link library (DLL), and all the applications that access said dynamic link library are also modified to conform with said modification of the DLL. Fig. 5a shows the typical manner by which an application 910a accesses a utility DLL 920a. Fig. 5b depicts the modifications made according to the third embodiment. The original utility DLL 920b is kept under a modified new name, while a proxy DLL 930b which implements the original DLL methods is kept under the name of the original DLL. One or more of the methods within the proxy DLL 930b are modified to raise an alert when they are called. For each modified method, the proxy DLL 930b supplies a renamed method which simply calls the original method within the renamed original utility DLL 920b. Any application which originally used the utility DLL 920a is modified to call all the renamed methods by their modified name. Thus, an application which is modified will ultimately succeed in calling the appropriate method within the renamed original DLL 920b, while any unmodified application will not only fail, but it will also be detected by the proxy DLL 930b.

    [0059] The underlying concept of the present invention as described above is not limited to the level of the operating system. It can also be implemented at the level of the instruction set. For example, the standard numeric code of one or more machine-level instructions may be altered in a manner unknown to authors of external programs, while preserving the original functionality of the instructions. This alteration can be obtained for example, by utilizing the "microcode update" facility which is available for modern AMD and Intel processors, or by using some other mechanism which allows such alterations. Alternatively, where a hypervisor is used, this alteration of the instruction set may be obtained by modifying the instruction set which is exposed by the hypervisor. When such low level modifications are made, the operating system along with useful benign programs should be patched to comply with the modified instruction set.

    [0060] Fig. 6 depicts a fourth embodiment of the present invention, where modifications are made at the level of the instruction set. The standard numeric code of a given instruction 820 is replaced by a modified instruction code 810, in a manner unknown to authors of external programs. Consequently, any program which is intended to use the modified instruction-set should be modified accordingly. When a modified program 800 issues a modified instruction code 810, the processor goes on to execute the original instruction 820. On the other hand, when an unmodified program 801 issues the unmodified instruction code 811, the processor raises an exception 821, which indicates an illegal operation. The term 'processor' in this context may refer either to a physical hardware processor, or to a virtual processor implemented by a hypervisor.

    [0061] The following fifth embodiment of the invention is described in terms of Java or similar bytecode, where either a Virtual Machine (VM) or a Just In Time (JIT) compiler is applied. Fig. 7a illustrates a first alternative of the fifth embodiment. Modified bytecode 7100 is processed by the modified Virtual Machine 7110, and goes on to normal execution 7120. On the other hand, when unmodified bytecode 7101 is processed by the modified Virtual Machine 7110, an alert 7121 is raised, and the bytecode program is not executed.

    [0062] Fig. 7b illustrates a second alternative of the fifth embodiment. Modified bytecode 7200 is processed by the modified JIT compiler 7210, and is compiled into valid native machine code 7220, which proceeds to normal execution 7230. On the other hand, when an unmodified bytecode 7201 is processed by the modified JIT compiler 7210, an alert 7221 is raised, and the bytecode program is not executed.

    [0063] The invention as described above is particularly useful for cases where a central authorization agent is responsible for (a) all operation system modifications and installations; and (b) all applications modifications and installations. Examples for such cases are isolated systems, SCADA, and organizational cellular devices. While some embodiments of the invention have been described by way of illustration, it will be apparent that the invention can be carried out with many modifications variations and adaptations, and with the use of numerous alternative solutions that are within the scope of persons skilled in the art, without exceeding the scope of the claims.


    Claims

    1. A method for providing a computerized system which is protected from malicious programs coming from an external source, the method comprises the steps of:

    a) secretly, and in a manner unknown to authors of external programs, modifying (210) at a central security authority one or more essential elements of an operating system of the protected system in a manner which causes all running programs to fail due to an exception which indicates an illegal operation, unless they are subjected to a compatible modification which enables them to run properly; and

    b) modifying (223) also at said central security authority each program which is known to be benign in order to comply with said modification of one or more essential elements, thereby to enable proper execution of the program, and running the modified program at the computerized system.


     
    2. Method according to claim 1, wherein said modifications involve a modification to one or more essential elements at the operating system, and to each benign program.
     
    3. Method according to claim 1, wherein when a program that does not comply with said modifications is found, the program is halted or sent to a sandbox, and an alert is raised.
     
    4. Method according to claim 1, wherein said modifications involve a modification to an operating system at said system, and wherein said modification to each benign program involves a compatible modification to the instruction set used by the program.
     
    5. Method according to claim 1, wherein said modifications involve a modification to an instruction set of a processor at said system, and wherein said modification to each benign program involves a compatible modification to the instruction set used by the program.
     
    6. Method according to claim 1 which is adapted for a static linking, wherein said modification at the protected system involves modification to at least one service routine and to a wrapper routine in the standard library, and wherein said modification to each of the benign programs is a compatible modification to a signature of the program.
     
    7. Method according to claim 1 which is adapted for a dynamic linking, wherein said modification at the protected system involves maintaining two copies of the dynamic standard library, a first copy of the dynamic standard library under its original name, and a under a modified name, and wherein said modification to each of the benign programs is a compatible modification to call said modified copy of the dynamic standard library.
     
    8. Method according to claim 7, which further includes a stub to detect programs that do not comply with said modification at the protected system.
     
    9. Method according to claim 1 which is adapted for a dynamic linking, wherein said modification at the protected system involves modification to a wrapper routine in the user mode and to the system call service routing in the kernel mode, and wherein said modification to each of the benign programs is a compatible modification to signatures of one or more system call invocations.
     
    10. Method according to claim 1 wherein said modification at the protected system involves modification to the names of one or more methods in a dynamic link library, and wherein each of the benign programs are modified to conform with said modification in said dynamic link library.
     
    11. Method according to claim 5, wherein the processor is a physical processor, a virtual processor or a hypervisor.
     
    12. Method according to claim 1, wherein said modifications are made on a temporal basis, each time a different subset of essential elements and respective parameters are selected for modification.
     
    13. Method according to claim 1, wherein the modification to said program further involves recompilation and/or relinking of the program and/or wherein the modification to said operating system further involves recompilation and/or relinking of the operating system.
     
    14. Method according to claim 1, wherein said modifications to one or more essential elements involve modifications to a virtual machine, and wherein said modification to each benign program involves a compatible modification to a bytecode used by the program and/or wherein said modifications to one or more essential elements involve modifications to a JIT compiler, and wherein said modification to each benign program involves a compatible modification to a bytecode used by the program.
     
    15. Method according to claim 5, wherein the modification of the instruction set is performed by utilizing the microcode update facility available on various modern processors.
     


    Ansprüche

    1. Verfahren zum Bereitstellen eines computergestützten Systems, das vor bösartigen Programmen geschützt ist, die aus einer externen Quelle stammen, wobei das Verfahren die Schritte umfasst:

    a) geheimes, und in einer Weise, die Autoren externer Programme unbekannt ist, Modifizieren (210) in einer zentralen Sicherheitsinstanz eines oder mehrerer wesentlicher Elemente eines Betriebssystems des geschützten Systems in einer Weise, die bewirkt, dass alle laufenden Programme wegen einer Ausnahme ausfallen, die eine illegale Operation anzeigt, sofern sie nicht einer kompatiblen Modifizierung unterzogen werden, die es ihnen ermöglicht, ordnungsgemäß zu laufen, und

    b) außerdem Modifizieren (223) in der zentralen Sicherheitsinstanz jedes Programms, das als gutartig bekannt ist, damit es der Modifizierung eines oder mehrerer wesentlicher Elemente entspricht, um dadurch eine ordnungsgemäße Ausführung des Programms zu ermöglichen, und Ausführen des modifizierten Programms in dem computergestützten System.


     
    2. Verfahren nach Anspruch 1, wobei die Modifizierungen eine Modifizierung eines oder mehrerer wesentlicher Elemente in dem Betriebssystem und an jedem gutartigen Programm beinhalten.
     
    3. Verfahren nach Anspruch 1, wobei, wenn ein Programm gefunden wird, das nicht mit den Modifizierungen übereinstimmt, das Programm angehalten oder zu einer Sandbox gesendet wird, und ein Alarm aktiviert wird.
     
    4. Verfahren nach Anspruch 1, wobei die Modifizierungen eine Modifizierung eines Betriebssystems in dem System beinhalten, und wobei die Modifizierung jedes gutartigen Programms eine kompatible Modifizierung des von dem Programm verwendeten Befehlssatzes beinhaltet.
     
    5. Verfahren nach Anspruch 1, wobei die Modifizierungen eine Modifizierung eines Befehlssatzes eines Prozessors in dem System beinhalten, und wobei die Modifizierung jedes gutartigen Programms eine kompatible Modifizierung des von dem Programm verwendeten Befehlssatzes beinhaltet.
     
    6. Verfahren nach Anspruch 1, das für eine statische Verlinkung ausgelegt ist, wobei die Modifizierung in dem geschützten System eine Modifizierung mindestens einer Service-Routine und einer Wrapper-Routine in der Standard-Bibliothek beinhaltet, und wobei die Modifizierung jedes der gutartigen Programme eine kompatible Modifizierung einer Signatur des Programms ist.
     
    7. Verfahren nach Anspruch 1, das für eine dynamische Verlinkung ausgelegt ist, wobei die Modifizierung in dem geschützten System beinhaltet, zwei Kopien der dynamischen Standard-Bibliothek zu verwalten, eine erste Kopie der dynamischen Standard-Bibliothek unter ihrem Originalnamen und eine unter einem modifizierten Namen, und wobei die Modifizierung jedes der gutartigen Programme eine kompatible Modifizierung zum Aufrufen der modifizierten Kopie der dynamischen Standard-Bibliothek ist.
     
    8. Verfahren nach Anspruch 7, das des Weiteren einen Stub enthält, um Programme zu detektieren, die nicht der Modifizierung in dem geschützten System entsprechen.
     
    9. Verfahren nach Anspruch 1, das für eine dynamische Verlinkung ausgelegt ist, wobei die Modifizierung in dem geschützten System eine Modifizierung einer Wrapper-Routine im Benutzermodus und der Systemruf-Service-Routine im Kernel-Modus beinhaltet, und wobei die Modifizierung jedes der gutartigen Programme eine kompatible Modifizierung von Signaturen von einem oder mehrerer Systemruf-Aufrufen ist.
     
    10. Verfahren nach Anspruch 1, wobei die Modifizierung in dem geschützten System eine Modifizierung der Namen eines oder mehrerer Verfahren in einer dynamischen Link-Bibliothek beinhaltet, und wobei jedes der gutartigen Programme so modifiziert wird, dass es der Modifizierung in der dynamischen Link-Bibliothek entspricht.
     
    11. Verfahren nach Anspruch 5, wobei der Prozessor ein physischer Prozessor, ein virtueller Prozessor oder ein Hypervisor ist.
     
    12. Verfahren nach Anspruch 1, wobei die Modifizierungen jedes Mal temporal vorgenommen werden, wenn eine andere Teilmenge wesentlicher Elemente und jeweiliger Parameter zur Modifizierung ausgewählt wird.
     
    13. Verfahren nach Anspruch 1, wobei die Modifizierung des Programms des Weiteren eine Rekompilation und/oder Neuverlinkung des Programms beinhaltet, und/oder wobei die Modifizierung des Betriebssystems des Weiteren eine Rekompilation und/oder Neuverlinkung des Betriebssystems beinhaltet.
     
    14. Verfahren nach Anspruch 1, wobei die Modifizierungen eines oder mehrerer wesentlicher Elemente Modifizierungen einer virtuellen Maschine beinhalten, und wobei die Modifizierung jedes gutartigen Programms eine kompatible Modifizierung eines Bytecodes beinhaltet, der von dem Programm verwendet wird, und/oder wobei die Modifizierungen eines oder mehrerer wesentlicher Elemente Modifizierungen eines JIT-Kompilierers beinhalten, und wobei die Modifizierung jedes gutartigen Programms eine kompatible Modifizierung eines Bytecodes beinhaltet, der von dem Programm verwendet wird.
     
    15. Verfahren nach Anspruch 5, wobei die Modifizierung des Befehlssatzes unter Verwendung der Mikrocode-Aktualisierungseinrichtung ausgeführt wird, die in verschiedenen modernen Prozessoren verfügbar ist.
     


    Revendications

    1. Procédé pour fournir un système informatisé qui est protégé de programmes malveillants provenant d'une source externe, le procédé comprenant les étapes :

    (a) de modification (210) secrètement, et d'une manière inconnue des auteurs des programmes externes, au niveau d'une autorité de sécurité centrale, d'un ou de plusieurs éléments essentiels d'un système d'exploitation du système protégé d'une manière qui amène tous les programmes qui s'exécutent à échouer du fait d'une exception qui indique une opération illégale, à moins qu'ils aient fait l'objet d'une modification compatible qui leur permet de fonctionner correctement ; et

    (b) de modification (223), également au niveau de ladite autorité de sécurité centrale, de chaque programme qui est connu comme étant bienveillant afin qu'il se conforme à ladite modification d'un ou de plusieurs éléments essentiels, pour de ce fait permettre l'exécution correcte du programme, et d'exécution du programme modifié au niveau du système informatisé.


     
    2. Procédé selon la revendication 1, dans lequel lesdites modifications impliquent une modification d'un ou de plusieurs éléments essentiels au niveau du système d'exploitation, et de chaque programme bienveillant.
     
    3. Procédé selon la revendication 1, dans lequel, lorsqu'un programme qui ne se conforme pas auxdites modifications est trouvé, le programme est arrêté ou envoyé vers un bac à sable, et une alerte est positionnée.
     
    4. Procédé selon la revendication 1, dans lequel lesdites modifications impliquent une modification d'un système d'exploitation au niveau dudit système, et dans lequel ladite modification de chaque programme bienveillant implique une modification compatible du jeu d'instructions utilisé par le programme.
     
    5. Procédé selon la revendication 1, dans lequel lesdites modifications impliquent une modification d'un jeu d'instructions d'un processeur au niveau dudit système, et dans lequel ladite modification de chaque programme bienveillant implique une modification compatible du jeu d'instructions utilisé par le programme.
     
    6. Procédé selon la revendication 1 qui est conçu pour une édition de liens statiques, dans lequel ladite modification au niveau du système protégé implique une modification d'au moins un sous-programme de service et d'un sous-programme d'encapsulation dans la bibliothèque standard, et dans lequel ladite modification de chacun des programmes bienveillants est une modification compatible d'une signature du programme.
     
    7. Procédé selon la revendication 1 qui est conçu pour une édition de liens dynamiques, dans lequel ladite modification au niveau du système protégé implique le maintien de deux copies de la bibliothèque dynamique standard, une première copie de la bibliothèque dynamique standard sous son nom d'origine, et une deuxième copie sous un nom modifié, et dans lequel ladite modification de chacun des programmes bienveillants est une modification compatible pour appeler ladite copie modifiée de la bibliothèque dynamique standard.
     
    8. Procédé selon la revendication 7, qui comprend en outre un élément de remplacement pour détecter les programmes qui ne sont pas conformes à ladite modification au niveau du système protégé.
     
    9. Procédé selon la revendication 1 qui est conçu pour une édition de liens dynamiques, dans lequel ladite modification au niveau du système protégé implique une modification d'un sous-programme d'encapsulation dans le mode utilisateur et de l'acheminement de service d'appel de système dans le mode noyau, et dans lequel ladite modification de chacun des programmes bienveillants est une modification compatible des signatures d'une ou de plusieurs invocations d'appel de système.
     
    10. Procédé selon la revendication 1, dans lequel ladite modification au niveau du système protégé implique une modification des noms d'un ou de plusieurs procédés dans une bibliothèque de liens dynamiques, et dans lequel chacun des programmes bienveillants est modifié pour qu'il se conforme à ladite modification dans ladite bibliothèque de liens dynamiques.
     
    11. Procédé selon la revendication 5, dans lequel le processeur est un processeur physique, un processeur virtuel ou un hyperviseur.
     
    12. Procédé selon la revendication 1, dans lequel lesdites modifications sont effectuées sur une base temporelle, à chaque fois qu'un sous-ensemble différent d'éléments essentiels et de paramètres respectifs est sélectionné pour une modification.
     
    13. Procédé selon la revendication 1, dans lequel la modification dudit programme implique en outre une recompilation et/ou une réédition de liens du programme, et/ou dans lequel la modification dudit système d'exploitation implique en outre une recompilation et/ou une réédition de liens du système d'exploitation.
     
    14. Procédé selon la revendication 1, dans lequel lesdites modifications d'un ou de plusieurs éléments essentiels impliquent des modifications d'une machine virtuelle, et dans lequel ladite modification de chaque programme bienveillant implique une modification compatible d'un pseudo code utilisé par le programme, et/ou dans lequel lesdites modifications d'un ou de plusieurs éléments essentiels impliquent des modifications d'un compilateur JIT, et dans lequel ladite modification de chaque programme bienveillant implique une modification compatible d'un pseudo code utilisé par le programme.
     
    15. Procédé selon la revendication 5, dans lequel la modification du jeu d'instructions est effectuée en utilisant l'équipement de mise à jour de microcode disponible sur divers processeurs modernes.
     




    Drawing



































    Cited references

    REFERENCES CITED IN THE DESCRIPTION



    This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

    Patent documents cited in the description