(19)
(11)EP 3 003 627 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
04.10.2023 Bulletin 2023/40

(21)Application number: 14728279.2

(22)Date of filing:  09.05.2014
(51)International Patent Classification (IPC): 
B23K 9/095(2006.01)
B23K 9/32(2006.01)
A61F 9/06(2006.01)
(52)Cooperative Patent Classification (CPC):
B23K 9/0956; B23K 9/321; G02B 2027/0178; A61F 9/06; G02B 27/0172; G02B 27/017; G02B 2027/0158; G02B 2027/0138; G02B 2027/014; G02B 2027/0187
(86)International application number:
PCT/IB2014/000702
(87)International publication number:
WO 2014/188244 (27.11.2014 Gazette  2014/48)

(54)

SYSTEMS PROVIDING A COMPUTERIZED EYEWEAR DEVICE TO AID IN WELDING

SYSTEME ZUR BEREITSTELLUNG EINER COMPUTERGESTÜTZTEN BRILLENVORRICHTUNG ZUR UNTERSTÜTZUNG BEIM SCHWEISSEN

SYSTÈMES CONSTITUANT UN DISPOSITIF DE LUNETTERIE INFORMATISÉ CONÇU COMME AIDE AU SOUDAGE


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 24.05.2013 US 201361827248 P
13.12.2013 US 201314105758

(43)Date of publication of application:
13.04.2016 Bulletin 2016/15

(73)Proprietor: Lincoln Global, Inc.
Santa Fe Springs, CA 90670 (US)

(72)Inventor:
  • MATTHEWS, William T.
    Chesterland, OH 44026 (US)

(74)Representative: Grosse Schumacher Knauer von Hirschhausen 
Patent- und Rechtsanwälte Schloss Schellenberg - Backhaus Renteilichtung 1
45134 Essen
45134 Essen (DE)


(56)References cited: : 
WO-A1-2009/146359
US-A1- 2008 158 502
US-A1- 2011 248 864
US-A1- 2012 180 180
US-A1- 2013 044 042
GB-A- 2 454 232
US-A1- 2010 062 405
US-A1- 2011 316 516
US-A1- 2012 291 172
  
  • STEVE MANN ET AL: "Realtime HDR (High Dynamic Range) video for eyetap wearable computers, FPGA-based seeing aids, and glasseyes (EyeTaps)", ELECTRICAL&COMPUTER ENGINEERING (CCECE), 2012 25TH IEEE CANADIAN CONFERENCE ON, IEEE, 29 April 2012 (2012-04-29), pages 1-6, XP032257134, ISSN: 0840-7789, DOI: 10.1109/CCECE.2012.6335012 ISBN: 978-1-4673-1431-2
  • Kyt Dotson: "Augmented Reality Welding Helmet Prototypes How Awesome the Technology Can Get", , 26 September 2012 (2012-09-26), XP055142955, Retrieved from the Internet: URL:http://siliconangle.com/blog/2012/09/2 6/augmented-reality-welding-helmet-prototy pes-how-awesome-the-technology-can-get/ [retrieved on 2014-09-26]
  • Terrence O'brien: "Google's Project Glass gets some more details", , 27 June 2012 (2012-06-27), XP055142972, Retrieved from the Internet: URL:http://www.engadget.com/2012/06/27/goo gles-project-glass-gets-some-more-details/ [retrieved on 2014-09-26]
  
Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


Description

TECHNICAL FIELD



[0001] The embodiments of the present invention relate to systems providing visualization and communication capabilities to a welder using a welding system via a computerized eyewear device. US2012180180 A1 discloses a known virtual reality system comprising eyeglasses with a frame and a HUD, and suitable to be worn whilst wearing a protective welding helmet.

BACKGROUND



[0002] Providing information to a welding student in real time during a welding process (whether a real-world welding process or a simulated welding process) is important to aid the welding student in the learning process. Similarly, providing information to an expert welder in real time during a real-world welding process can aid the expert welder in the welding process. Furthermore, providing the ability for a welding student or an expert welder to easily communicate with (e.g., provide commands to) a welding system (real or simulated) can allow for a more efficient and user-friendly welding experience. Today, a welding helmet may be provided with simple light indicators representative of welding information which don't require a welder to be able to focus sharply on the light indicators, since the light indicators may be within one inch of the welder's eye. Simply being able to see that the color of a light indicator is red or green or yellow, for example, is provided. Thus, there is an ongoing need to improve how a welder or welding student interacts with a welding system and how information is provided and viewed in real time.

[0003] Further limitations and disadvantages of conventional, traditional, and proposed approaches will become apparent to one of skill in the art, through comparison of such systems and methods with embodiments of the present invention as set forth in the remainder of the present application with reference to the drawings.

SUMMARY



[0004] In order to solve this problem, the invention proposes an arc welding system according to claim 2 and a virtual reality welding system according to claim 1. More specific solutions may be taken from the subclaims. It is noted that the features of the subclaims are applicable to both types of systems mentioned herebefore. In one embodiment, a system is provided. The system includes a welding power source of an arc welding system and a computerized eyewear device having a head-up display (HUD). The computerized eyewear device is configured to be worn by a user as eye glasses are worn, while the user also wears a protective welding helmet. The computerized eyewear device is further configured to wirelessly communicate with the welding power source of the arc welding system. The computerized eyewear device may receive information from the welding power source and display the information on the HUD. Furthermore, the user may provide commands to the welding power source via the computerized eyewear device (e.g., via voice activation). The welding power source and the computerized eyewear device may be cooperatively configured to provide one or more of augmented indicators indicative of a user's welding technique and sequencer functionality indicative of a next weld to be made on the HUD, for example.

[0005] In another embodiment, a system is provided. The system includes a programmable processor-based subsystem of a virtual reality welding simulation system and a computerized eyewear device having a head-up display (HUD). The computerized eyewear device is configured to be worn by a user as eye glasses are worn, while the user also wears a protective welding helmet. The computerized eyewear device is further configured to wirelessly communicate with the programmable processor-based subsystem of the virtual reality welding simulation system. The computerized eyewear device may receive information from the programmable processor-based subsystem and display the information on the HUD. Furthermore, the user may provide commands to the programmable processor-based subsystem via the computerized eyewear device (e.g., via voice activation). The programmable processor-based subsystem and the computerized eyewear device may be cooperatively configured to provide one or more of virtual reality images associated with a virtual reality welding process and virtual cues and indicators associated with a virtual reality welding process on the HUD, for example.

[0006] In accordance with an embodiment, the computerized eyewear device includes a frame configured to be worn on the head of a user, the frame including a bridge configured to be supported on the nose of the user, a brow portion coupled to and extending away from the bridge to a first end remote therefrom and configured to be positioned over a first side of a brow of the user, and a first arm having a first end coupled to the first end of the brow portion and extending to a free end, the first arm being configured to be positioned over a first temple of the user with the free end disposed near a first ear of the user, wherein the bridge is adjustable for selective positioning of the brow portion relative to an eye of the user. The computerized eyewear device also includes a transparent display (the HUD) which may be affixed to the frame and may be movable with respect to the frame through rotation about a first axis that extends parallel to the first brow portion. The computerized eyewear device also includes a housing containing control and communication circuitry affixed to the frame. As an example, the computerized eyewear device may be a Google Glass device configured for operation with an arc welding system or a virtual reality arc welding simulation system.

[0007] Details of illustrated embodiments of the present invention will be more fully understood from the following description and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS



[0008] 

Fig. 1 illustrates a diagram of an exemplary embodiment of an arc welding system and a computerized eyewear device configured to communicate with the arc welding system;

Fig. 2 illustrates a diagram of an exemplary embodiment of the computerized eyewear device of Fig. 1; and

Fig. 3 illustrates a diagram of an exemplary embodiment of a virtual reality welding system and a computerized eyewear device configured to communicate with the virtual reality welding system.


DETAILED DESCRIPTION



[0009] The following are definitions of exemplary terms that may be used within the disclosure. Both singular and plural forms of all terms fall within each meaning:

[0010] "Software" or "computer program" as used herein includes, but is not limited to, one or more computer readable and/or executable instructions that cause a computer or other electronic device to perform functions, actions, and/or behave in a desired manner. The instructions may be embodied in various forms such as routines, algorithms, modules or programs including separate applications or code from dynamically linked libraries. Software may also be implemented in various forms such as a stand-alone program, a function call, a servlet, an applet, an application, instructions stored in a memory, part of an operating system or other type of executable instructions. It will be appreciated by one of ordinary skill in the art that the form of software is dependent on, for example, requirements of a desired application, the environment it runs on, and/or the desires of a designer/programmer or the like.

[0011] "Computer" or "processing element" or "computerized device" as used herein includes, but is not limited to, any programmed or programmable electronic device that can store, retrieve, and process data. "Non-transitory computer-readable media" include, but are not limited to, a CD-ROM, a removable flash memory card, a hard disk drive, a magnetic tape, and a floppy disk.

[0012] "Computer memory", as used herein, refers to a storage device configured to store digital data or information which can be retrieved by a computer or processing element.

[0013] "Controller", as used herein, refers to the logic circuitry and/or processing elements and associated software or program involved in controlling a device, system, or portion of a system.

[0014] The terms "signal", "data", and "information" may be used interchangeably herein and may be in digital or analog form.

[0015] The term "welding parameter" is used broadly herein and may refer to characteristics of a portion of a welding output current waveform (e.g., amplitude, pulse width or duration, slope, electrode polarity), a welding process (e.g., a short arc welding process or a pulse welding process), wire feed speed, a modulation frequency, a welding travel speed, or some other parameter associated with real-world welding or simulated welding.

[0016] The term "head up display", as used herein, refers to a transparent display that presents information (e.g., high quality images) without requiring a user to look away from their usual viewpoints.

[0017] An arc welding system according to the invention is defined in claim 2. The arc welding system includes a welding power source and a computerized eyewear device having a head-up display (HUD) and control and communication circuitry (CCC) operatively connected to the HUD. The computerized eyewear device is configured to be worn by a user as eye glasses are worn, while also wearing a protective welding helmet, and wirelessly communicate with the welding power source. The control and communication circuitry is configured to wirelessly receive information from the welding power source and display the information on the HUD.

[0018] In accordance with an embodiment, the computerized eyewear device includes a microphone operatively connected to the control and communication circuitry. The microphone and the control and communication circuitry are configured to receive voice-activated user command information and wirelessly transmit the voice-activated user command information to the welding power source. In accordance with an embodiment, the computerized eyewear device includes a camera operatively connected to the control and communication circuitry. The camera and the control and communication circuitry are configured to capture one or more of still pictures and moving video. In accordance with an embodiment, the control and communication circuitry is configured to access the internet through a wireless access point.

[0019] In accordance with an embodiment, the computerized eyewear device includes a frame configured to be worn on the head of a user and at least one housing affixed to the frame containing one or more of the control and communication circuitry, the microphone, and the camera. The HUD is also affixed to the frame and is movable with respect to the frame through rotation about a first axis that extends parallel to a first brow portion. Optionally, the computerized eyewear device may include at least one prescription optical lens held in place by the frame.

[0020] In accordance with an embodiment, the frame includes a bridge configured to be supported on the nose of the user, a brow portion coupled to and extending away from the bridge to a first end remote therefrom and configured to be positioned over a first side of a brow of the user, and a first arm having a first end coupled to the first end of the brow portion and extending to a free end. The first arm is configured to be positioned over a first temple of the user with the free end disposed near a first ear of the user. In accordance with an embodiment, the bridge is adjustable for selective positioning of the brow portion relative to an eye of the user.

[0021] Fig. 1 illustrates a diagram of an exemplary embodiment of an arc welding system 100 and a computerized eyewear device 150 configured to communicate with the arc welding system 100. The arc welding system 100 includes a wire feeder 110, a welding gun or tool 120, a shielding gas supply 130, and a welding power source 140. The wire feeder 110, the welding gun 120, the shielding gas supply 130, and the power source 140 are operatively connected to allow a welder to create an electric arc between a welding wire and a workpiece W to create a weld as is well known in the art.

[0022] In accordance with an embodiment, the welding power source 140 includes a switching power supply (not shown), a waveform generator (not shown), a controller (not shown), a voltage feedback circuit (not shown), a current feedback circuit (not shown), and a wireless communication circuit 145. The wire feeder 110 feeds the consumable wire welding electrode E toward the workpiece W through the welding gun (welding tool) 120 at a selected wire feed speed (WFS). The wire feeder 110, the consumable welding electrode E, and the workpiece W are not part of the welding power source 140 but may be operatively connected to the welding power source 140 via a welding output cable.

[0023] The computerized eyewear device 150 is configured to be worn by a user as eye glasses are worn, while also wearing a conventional protective welding helmet. The protective welding helmet may be a conventional welding helmet that does not have to be modified in any way to accommodate the computerized eyewear device 150. Furthermore, the computerized eyewear device 150 is configured to wirelessly communicate with the welding power source 140 via the wireless communication circuit 145 of the welding power source 140. The wireless communication circuit 145 may include a processor, computer memory, a transmitter, a receiver, and an antenna, in accordance with an embodiment.

[0024] Referring now to Fig. 1 and Fig. 2, where Fig. 2 illustrates a diagram of an exemplary embodiment of the computerized eyewear device 150 of Fig. 1, the computerized eyewear device 150 includes a frame 151 configured to be worn on the head of a user. The frame 151 includes a bridge 152 configured to be supported on the nose of the user and a brow portion 153 coupled to and extending away from the bridge 152 to a first and second ends remote therefrom and configured to be positioned over the brows of the user.

[0025] The frame also includes a first arm 154 having a first end coupled to the first end of the brow portion 153 and extending to a free end, the first arm being configured to be positioned over a first temple of the user with the free end disposed near a first ear of the user. The frame 151 also includes a second arm 155 having a first end coupled to the second end of the brow portion 153 and extending to a free end, the second arm being configured to be positioned over a second temple of the user with the free end disposed near a second ear of the user. The bridge 152 may be adjustable for selective positioning of the brow portion 153 relative to the eyes of the user, in accordance with an embodiment.

[0026] The computerized eyewear device 150 includes a transparent display (e.g., a HUD) 156 affixed to the frame 151. The HUD 156 is with respect to the frame 151 through rotation about a first axis that extends parallel to the brow portion 153, in accordance with an embodiment, and may be configured to display text, graphics, and images. The computerized eyewear device 150 also includes control and communication circuitry (e.g., a computer) 157 enclosed in a housing 162 and affixed to the frame 151. The control and communication circuitry 157 may include a processor and memory, for example. The memory may be coupled to the processor and store software that can be accessed and executed by the processor. The processor may be a microprocessor or a digital signal processor, for example. As an option, the computerized eyewear device 150 may include a camera 158. The HUD 156 and the control and communication circuitry 157 (and, optionally, the camera 158) are operatively connected to provide the functionality described herein. In accordance with an embodiment, the camera 158 is configured to capture still pictures and moving video. In this way, a user may record the welding scenario as viewed by the user from inside the welding helmet.

[0027] In accordance with an embodiment, the control and communication circuitry 157 provides two-way communication with the wireless communication circuit 145 of the welding power source 140. Information may be provided from the welding power source 140 to the computerized eyewear device 150 and displayed on the HUD 156. Furthermore, in accordance with an embodiment, the control and communication circuitry 157 is configured to accept voice-activated commands from a user and transmit the commands to the welding power source 140. Communication between the welding power source 140 and the computerized eyewear device 150 may be accomplished by way of, for example, Bluetooth® radio technology, communication protocols described in IEEE 802.11 (including any IEEE 802.11 revisions), cellular technology (such as GSM, CDMA, UMTS, EVDO, WiMax, or LTE), or ZigBee® technology, among other possibilities. In accordance with an embodiment, the computerized eyewear device may also include at least one optical lens 163 that matches a user's corrective visual prescription. In accordance with a further embodiment, the computerized eyewear device may be modular and attachable to normal prescription eye glasses.

[0028] Furthermore, in accordance with an embodiment, the welding power source 140 may be accessible by the computerized eyewear device 150 via the Internet. For example, the control and communication circuitry 157 may be configured to access the Internet through a wireless hot spot (e.g., a smart phone or a wireless router) and access the welding power source 140 therethrough. Alternatively, the welding power source 140 may be configured to access the Internet and provide information obtained from the Internet to the computerized eyewear device 150.

[0029] Information that may be displayed on the HUD 156 during a real-world welding scenario that may be useful to a welder may be in the form of text, an image, or a graphic. Such information may include, for example, the arc welding process, a welding tool travel angle, a welding tool travel speed, a tip-to-work distance, a wire feed speed, a welding polarity, an output voltage level, an output current level, an arc length, a dime spacing, a whip time, a puddle time, a width of weave, a weave spacing, a tolerance window, a number score, and welding sequence steps. Other information may be displayed as well, in accordance with other embodiments. For example, in an augmented mode, instructional indicators that are used in a virtual reality training environment may be superimposed over an actual weld using the HUD 156. In this manner, a welding student who trained on a virtual reality welding system can transition to a real welding scenario and have the same instructional indicators provided via the HUD. Visual cues or indicators are displayed to the welder on the HUD of the computerized eyewear device to indicate to the welder if a particular parameter (e.g., a welding tool travel angle) is within an acceptable range or not. Such visual cues or indicators may aid in training by helping an inexperienced welder or welding student to improve his welding technique.

[0030] The acquisition of some of the information may rely on the welding tool being spatially tracked (e.g., travel angle, travel speed, tip-to-work distance). In accordance with an embodiment, the welding tool may include an accelerometer device that is operatively connected to the welding power source to provide spatial position or movement information. Other methods of tracking the welding tool are possible as well, such as magnetic tracking techniques, for example.

[0031] In accordance with an embodiment, the computerized eyewear device 150 includes a microphone 159 for receiving voice-activated commands from a user. The voice-activated commands, as initiated by a welder, that may be accommodated by the computerized eyewear device 150 in communication with the welding power source 140 may include, for example, commands to change a welding parameter such as a wire feed speed, a welding polarity, and a welding output current level. Other types of commands may be possible as well, in accordance with other embodiments.

[0032] In accordance with an embodiment, the computerized eyewear device 150 and/or the welding power source 140 may be programmed with one or more welding software applications configured to accommodate use of the computerized eyewear device 150 with the arc welding system 100. For example, an embodiment of one welding software application may provide a "good weld" recognition capability. Similar to a facial recognition capability, the "good weld" recognition capability may use the camera 158 to acquire an image of a weld created by the user, analyze the image, and provide feedback to the user on the HUD 156 as to the overall external quality of the weld. For example, the text "poor weld", "fair weld", or "good weld" may be displayed to the user. The user may have to take off his welding helmet or lift a visor on the welding helmet to acquire an image of the weld. The welding software application may reside in the computerized eyewear device 150, the welding power source 140, or a combination of both, in accordance with various embodiments.

[0033] As another example, an embodiment of a welding software application may provide a welding sequencing capability. When welding a part or assembly with many welds, it is not desirable for a welder to miss a weld. A welding software application may step a welder through the multiple welds for the part. For example, as a welder finishes a current weld on a part or assembly requiring multiple welds, the welder may give a voice command of "next weld". As a result, the welding software application may display to the welder on the HUD 156 an image or graphic (e.g., a 3D representation of the part) providing the location of the next weld to be performed. The type of weld and other information associated with the weld may also be displayed. In accordance with an embodiment where the computerized eyewear device 150 is being spatially tracked, as discussed later herein, the welding software application may display a graphic on the HUD such that graphic indicator is overlaid onto the assembly at the next location to be welded. Other types of welding software applications that operate with the computerized eyewear device are possible as well, in accordance with other embodiments. A virtual reality welding system according to the invention is defined in claim 1. The virtual reality welding system includes a programmable processor-based subsystem and a computerized eyewear device having a head-up display (HUD) and control and communication circuitry (CCC) operatively connected to the HUD. The computerized eyewear device is configured to be worn by a user as eye glasses are worn, and to wirelessly communicate with the programmable processor-based subsystem. The control and communication circuitry is configured to wirelessly receive information from the programmable processor-based subsystem and display the information on the HUD.

[0034] In accordance with an embodiment, the computerized eyewear device further includes a microphone operatively connected to the control and communication circuitry and configured to receive voice-activated user command information and wirelessly transmit the voice-activated user command information to the programmable processor-based subsystem. Alternatively, or in addition, the computerized eyewear device may include a touch-sensitive user interface operatively connected to the control and communication circuitry and configured to allow a user to select command information and wirelessly transmit the command information to the programmable processor-based subsystem.

[0035] In accordance with an embodiment, the computerized eyewear device includes a camera operatively connected to the control and communication circuitry. The camera and the control and communication circuitry are configured to capture one or more of still pictures and moving video. In accordance with an embodiment, the control and communication circuitry is configured to access the internet through a wireless access point.

[0036] In accordance with an embodiment, the computerized eyewear device includes a frame configured to be worn on the head of a user and at least one housing affixed to the frame containing one or more of the control and communication circuitry, the microphone, and the camera. The HUD is also affixed to the frame and is movable with respect to the frame through rotation about a first axis that extends parallel to a first brow portion. Optionally, the computerized eyewear device may include at least one prescription optical lens held in place by the frame.

[0037] In accordance with an embodiment, the frame includes a bridge configured to be supported on the nose of the user, a brow portion coupled to and extending away from the bridge to a first end remote therefrom and configured to be positioned over a first side of a brow of the user, and a first arm having a first end coupled to the first end of the brow portion and extending to a free end. The first arm is configured to be positioned over a first temple of the user with the free end disposed near a first ear of the user. In accordance with an embodiment, the bridge is adjustable for selective positioning of the brow portion relative to an eye of the user.

[0038] In accordance with an embodiment, the computerized eyewear device includes at least one motion sensing device operatively connected to the control and communication circuitry and configured to provide spatial information to the programmable processor-based subsystem as a user moves his head.

[0039] Fig. 3 illustrates a diagram of an exemplary embodiment of a virtual reality arc welding system 300 and a computerized eyewear device 150 configured to communicate with the virtual reality welding system 300. The virtual reality arc welding (VRAW) system includes a programmable processor-based subsystem, a spatial tracker operatively connected to the programmable processor-based subsystem, at least one mock welding tool capable of being spatially tracked by the spatial tracker, and at least one display device operatively connected to the programmable processor-based subsystem. In accordance with an embodiment, the computerized eyewear device 150 may also be spatially tracked by the spatial tracker. The system is capable of simulating, in a virtual reality space, a weld puddle having real-time molten metal fluidity and heat dissipation characteristics. The system is also capable of displaying the simulated weld puddle on the display device in real-time.

[0040] The system 300 includes a programmable processor-based subsystem (PPS) 310. The system 300 further includes a spatial tracker (ST) 320 operatively connected to the PPS 310. The system 300 also includes a physical welding user interface (WUI) 330 operatively connected to the PPS 310 as well as the computerized eyewear device 150 in operative wireless communication with the PPS 310 via a wireless communication circuit 145 of the PPS 310. The system 300 further includes an observer display device (ODD) 340 operatively connected to the PPS 310. The system 300 also includes at least one mock welding tool (MWT) 350 operatively connected to the ST 320 and the PPS 310. The system 300 further includes a table/stand (T/S) 360 and at least one welding coupon (WC) 370 capable of being attached to the T/S 360. In accordance with an alternative embodiment of the present invention, a mock gas bottle is provided (not shown) simulating a source of shielding gas and having an adjustable flow regulator.

[0041] In accordance with an embodiment, the computerized eyewear device 150 is configured as previously described herein. However, in this embodiment, the control and communication circuitry 157 provides two-way communication with the wireless communication circuit 145 of the PPS 310. Information may be provided from the PPS 310 to the computerized eyewear device 150 and displayed on the HUD 156. Furthermore, in accordance with an embodiment, the control and communication circuitry 157 is configured to accept voice-activated commands from a user and transmit the commands to the PPS 310. Communication between the PPS 310 and the computerized eyewear device 150 may be accomplished by way of, for example, Bluetooth® radio technology, communication protocols described in IEEE 802.11 (including any IEEE 802.11 revisions), cellular technology (such as GSM, CDMA, UMTS, EVDO, WiMax, or LTE), or ZigBee® technology, among other possibilities.

[0042] Furthermore, in accordance with an embodiment, the PPS 310 may be accessible by the computerized eyewear device 150 via the Internet. For example, the control and communication circuitry 157 may be configured to access the Internet through a wireless hot spot (e.g., a smart phone or a wireless router) and access the PPS 310 therethrough. Alternatively, the PPS 310 may be configured to access the Internet and provide information obtained from the Internet to the computerized eyewear device 150.

[0043] As before, the user may wear a conventional welding helmet over the computerized eyewear device 150. However, since the welding scenario is a simulated welding scenario, the conventional welding helmet may be fitted with a transparent lens instead of a protective lens that protects against the light and other radiation emitted by a real arc. As such, the user may see through the transparent lens to view the welding coupon 370 and the mock welding tool 350, for example.

[0044] In accordance with an embodiment, the computerized eyewear device 150 is configured with an accelerometer device 160 that is operatively connected to the control and communication circuitry 157. Spatial information provided by the accelerometer device as the user moves his head is communicated to the PPS 110 and then to the spatial tracker 320. In this manner, the spatial relationship between the surrounding environment and what the user is seeing through the HUD 156 of the computerized eyewear device 150 may be correlated. As the user proceeds with the virtual welding process using the system 300, anything displayed on the HUD 156 (e.g., a virtual weld puddle) will appear overlaid onto, for example, the welding coupon 370 as the user views the welding coupon through the transparent lens of the conventional welding helmet. In accordance with other embodiments, other motion sensing devices besides that of an accelerometer device may be used. A calibration procedure may be initially performed to correlate the view of the user through the HUD to the surrounding environment, in accordance with an embodiment.

[0045] The real-time molten metal fluidity and heat dissipation characteristics of the simulated weld puddle provide real-time visual feedback to a user of the mock welding tool when displayed (e.g., on the HUD of the computerized eyewear device 150 as tracked by the spatial tracker 320), allowing the user to adjust or maintain a welding technique in real-time in response to the real-time visual feedback (i.e., helps the user learn to weld correctly). When the computerized eyewear device 150 is being spatially tracked, the weld puddle will appear at a correct location with respect to the welding coupon as viewed through the HUD.

[0046] The displayed weld puddle is representative of a weld puddle that would be formed in the real-world based on the user's welding technique and the selected welding process and parameters. By viewing a puddle (e.g., shape, color, slag, size, stacked dimes), a user can modify his technique to make a good weld and determine the type of welding being done. The shape of the puddle is responsive to the movement of the gun or stick.

[0047] The term "real-time", as used herein with respect to a virtual reality or simulated environment, means perceiving and experiencing in time in a virtual or simulated environment in the same way that a user would perceive and experience in a real-world welding scenario. Furthermore, the weld puddle is responsive to the effects of the physical environment including gravity, allowing a user to realistically practice welding in various positions including overhead welding and various pipe welding angles (e.g., 1G, 2G, 5G, 6G).

[0048] Information that may be useful to a welding student to display on the HUD 156 during a virtual or simulated welding scenario may be in the form of text, an image, or a graphic. Such information may include, for example, the arc welding process, a welding tool travel angle, a welding tool travel speed, a tip-to-work distance, a set wire feed speed, a set welding polarity, a simulated output voltage level, a set output current level, a simulated arc length, a dime spacing, a whip time, a puddle time, a width of weave, a weave spacing, a tolerance window, a number score, and welding sequence steps. Other information may be displayed as well, in accordance with other embodiments.

[0049] In accordance with an embodiment, the computerized eyewear device 150 includes a microphone 159 that is operatively connected to the control and communication circuitry 157 for receiving voice-activated commands from a user. The voice-activated commands, as initiated by a welder, that may be accommodated by the computerized eyewear device 150 in communication with the PPS 310 may include, for example, commands to change a welding parameter such as a simulated wire feed speed, a simulated welding polarity, and a simulated welding output current level. Other types of commands may be possible as well, in accordance with other embodiments.

[0050] In accordance with an embodiment, the computerized eyewear device 150 and/or the PPS 310 may be programmed with one or more welding training software applications configured to accommodate use of the computerized eyewear device 150 with the virtual reality arc welding system 300. For example, an embodiment of one welding software application may provide a "good weld" recognition capability. Similar to a facial recognition capability, the "good weld" recognition capability may use an image of a simulated weld created by the user, analyze the image, and provide feedback to the user on the HUD 156 as to the overall external quality of the weld. For example, the text "poor weld", "fair weld", or "good weld" may be displayed to the user. The welding software application may reside in the computerized eyewear device 150, the PPS 310, or a combination of both, in accordance with various embodiments.

[0051] As another example, an embodiment of a welding software application may provide a welding sequencing capability. As a welder finishes a current simulated weld on a welding coupon requiring multiple welds, the welder may give a voice command of "next weld". As a result, the welding software application may display to the welder on the HUD 156 an image or graphic providing the location of the next weld to be performed. The type of weld and other information associated with the weld may also be displayed. In accordance with an embodiment where the computerized eyewear device 150 is being spatially tracked, as discussed herein, the welding software application may display a graphic on the HUD such that the graphic is overlaid onto the welding coupon at the next location to be welded. Other types of welding software applications that operate with the computerized eyewear device are possible as well, in accordance with other embodiments.

[0052] The computerized eyewear device 150 may be configured to be used with other welding simulation systems in accordance with other embodiments. For example, welding simulations performed on a personal computer (PC) or a tablet computer may be communicatively and functionally integrated with the computerized eyewear device 150 to aid a welding student in learning how to weld.

[0053] One optional embodiment of the computerized eyewear device may provide a touch-sensitive user interface (TSUI) 161 which the welding student can use instead of or in addition to voice-activated commands. Such a TSUI would be accessible to the welding student when not wearing a welding helmet, for example. In accordance with an embodiment, the TSUI 161 is operatively connected to the control and communication circuitry 157.

[0054] In summary, systems and methods to aid a welder or welding student are provided. A system may include a real-world arc welding system or a virtual reality arc welding system along with a computerized eyewear device having a head-up display (HUD). The computerized eyewear device is configured to be worn by a user under a conventional welding helmet as eye glasses are worn and wirelessly communicates with a welding power source of a real-world arc welding system or a programmable processor-based subsystem of a virtual reality arc welding system.

[0055] This written description uses examples to disclose the invention, including the best mode, and also to enable one of ordinary skill in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The scope of the invention is defined by the claims.

[0056] While the invention of the present application has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from its scope. Therefore, it is intended that the invention not be limited to the particular embodiments disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.
REFERENCE NUMBERS:
100 arc welding system 160 accelerometer device
110 wire feeder 161 touchsensitive user interface
120 welding gun/ tool 162 housing
130 shielding gas supply 163 optical lens
140 welding power source 300 arc welding system
145 wireless communication circuit 310 programmable processor-based system (PPS)
150 eyewear device
151 frame 320 spatial tracker
152 bridge 330 user interface
153 brow portion 340 observer display device
154 first arm 350 mock welding tool
155 second arm 360 table/stand
156 HUD 370 welding coupon
157 communication circuitry W workpiece
158 camera E electrode
159 microphone    



Claims

1. A virtual reality welding system, comprising:

a protective welding helmet;

a programmable processor-based subsystem (310); and

a computerized eyewear device (150) having a head-up display (HUD) (156) and control and communication circuitry (157) operatively connected to the HUD (156),

wherein the programmable processor-based subsystem (310) and the computerized eyewear device (150) are cooperatively configured to provide one or more of virtual reality images associated with a virtual reality welding process and virtual cues and indicators associated with a virtual reality welding process o the HUD (156);

wherein the computerized eyewear device (150) is configured to:

be worn by a user as eye glasses are worn while also wearing the protective welding helmet; and

wirelessly communicate with the programmable processor-based subsystem (310);

wherein the computerized eyewear device (150) further includes a frame (151) configured to be worn on the head of the user;

wherein the HUD (156) is affixed to the frame (151) and is movable with respect to the frame through rotation about a first axis that extends parallel to a brow portion (153) of the frame (151).


 
2. An arc welding system, comprising:

a protective welding helmet;

a welding power source (140); and

a computerized eyewear device (150) having a head-up display (HUD 156) and control and communication circuitry (157) operatively connected to the HUD (156), wherein the computerized eyewear device (150) is configured to:

be worn by a user as eye glasses are worn while also wearing the protective welding helmet; and

wirelessly communicate with the welding power source (140);

wherein the computerized eyewear device (150) further includes a frame (151) configured to be worn on the head of the user;

wherein the HUD (156) is affixed to the frame (151) and is movable with respect to the frame through rotation about a first axis that extends parallel to a brow portion (153) of the frame (151);

wherein the welding power source (140) and the computerized eyewear device (150) are cooperatively configured to provide one or more of augmented indicators indicative of a user's welding technique and sequencer functionality indicative of a next weld to be made on the HUD.


 
3. The system of claim 1 or of claim 2, wherein the control and communication circuitry (157) is configured to wirelessly receive information from the welding power source or from the programmable processor-based subsystem and display the information on the HUD.
 
4. The system of one of the claims 1 to 3, wherein the computerized eyewear device (150) further includes a microphone (159) operatively connected to the control and communication circuitry (157) and configured to receive voice-activated user command information and wirelessly transmit the voice-activated user command information to the welding power source or to the programmable processor-based subsystem, and/or wherein the computerized eyewear device (150) further includes a camera (158) operatively connected to the control and communication circuitry (157) and configured to capture one or more of still pictures and moving video.
 
5. The system of one of the claims 1 to 4, wherein the control and communication circuitry (157) is configured to access the internet through a wireless access point.
 
6. The system of one of the claims 1 to 5, wherein the computerized eyewear device (150) further includes at least one housing (162) affixed to the frame (151) containing one or more of the control and communication circuitry (157), the microphone (159), and the camera (158).
 
7. The system of one of the claims 1 to 6, wherein the frame (151) includes a bridge (152) configured to be supported on the nose of the user, the brow portion (153) coupled to and extending away from the bridge to a first end remote therefrom and configured to be positioned over a first side of a brow of the user, and a first arm having a first end coupled to the first end of the brow portion and extending to a free end, the first arm being configured to be positioned over a first temple of the user with the free end disposed near a first ear of the user.
 
8. The system of claim 7, wherein the bridge (152) is adjustable for selective positioning of the brow portion (153) relative to an eye of the user.
 
9. The system of one of the claims 1 to 8, wherein the computerized eyewear device (150) further includes at least one prescription optical lens (163) held in place by the frame (151).
 
10. The system of one of the claims 1 to 9, wherein the computerized eyeweari device (150) further includes a microphone, a motion sensing device and/or a touch-sensitive user interface (330).
 
11. The system of claim 1, wherein the computerized eyewear device (150) further includes at least one motion sensing device operatively connected to the control and communication circuitry (157) and configured to provide spatial information to the programmable processor-based subsystem as a user moves his head.
 
12. The system of claim 1, wherein the computerized eyewear device (150) further includes a touch-sensitive user interface (161) operatively connected to the control and communication circuitry (157) and configured to allow a user to select command information and wirelessly transmit the command information to the programmable processor-based subsystem.
 


Ansprüche

1. Virtual-Reality-Schweißsystem, das umfasst:

eine Schweißerschutzhaube;

ein programmierbares prozessorgestütztes Teilsystem (310); und

eine computerisierte Brillenvorrichtung (150), die ein Head-up-Display (HUD) (156) und eine Steuer- und Kommunikationsschaltung (157), die mit dem HUD (156) wirkverbunden ist, aufweist,

wobei das programmierbare prozessorgestützte Teilsystem (310) und die computerisierte Brillenvorrichtung (150) im Zusammenwirken dafür konfiguriert sind, eines oder mehrere von Virtual-Reality-Bildern, die mit einem Virtual-Reality-Schweißprozess verknüpft sind, und virtuellen Hinweisen und Indikatoren, die mit einem Virtual-Reality-Schweißprozess des HUD (156) verknüpft sind, bereitzustellen;

wobei die computerisierte Brillenvorrichtung (150) dafür konfiguriert ist:

von einem Benutzer wie eine Brille getragen zu werden, während er gleichzeitig die Schweißerschutzhaube trägt; und

drahtlos mit dem programmierbaren prozessorgestützten Teilsystem (310) zu kommunizieren;

wobei die computergestützte Brillenvorrichtung (150) des Weiteren einen Rahmen (151) enthält, der dafür konfiguriert ist, auf dem Kopf des Benutzers getragen zu werden;

wobei das HUD (156) an dem Rahmen (151) befestigt ist und in Bezug auf den Rahmen durch Drehung um eine erste Achse, die sich parallel zu einem Brauenabschnitt (153) des Rahmens (151) erstreckt, beweglich ist.


 
2. Lichtbogenschweißsystem, das umfasst:

eine Schweißerschutzhaube;

eine Schweißstromquelle (140); und

eine computerisierte Brillenvorrichtung (150), die ein Head-up-Display (HUD 156) und eine Steuer- und Kommunikationsschaltung (157), die mit dem HUD (156) wirkverbunden ist, aufweist, wobei die computerisierte Brillenvorrichtung (150) dafür konfiguriert ist:

von einem Benutzer wie eine Brille getragen zu werden, während er gleichzeitig die Schweißerschutzhaube trägt; und

drahtlos mit der Schweißstromquelle (140) zu kommunizieren;

wobei die computergestützte Brillenvorrichtung (150) des Weiteren einen Rahmen (151) enthält, der dafür konfiguriert ist, auf dem Kopf des Benutzers getragen zu werden;

wobei das HUD (156) an dem Rahmen (151) befestigt ist und in Bezug auf den Rahmen durch Drehung um eine erste Achse, die sich parallel zu einem Brauenabschnitt (153) des Rahmens (151) erstreckt, beweglich ist;

wobei die Schweißstromquelle (140) und die computerisierte Brillenvorrichtung (150) im Zusammenwirken dafür konfiguriert sind, eines oder mehrere von augmentierten Indikatoren, die eine Schweißtechnik eines Benutzers angeben, und einer Sequenzerfunktionalität, die eine auf dem HUD auszuführende nächste Schweißnaht angibt, bereitzustellen.


 
3. System nach Anspruch 1 oder Anspruch 2, wobei die Steuer- und Kommunikationsschaltung (157) dafür konfiguriert ist, drahtlos Informationen von der Schweißstromquelle oder von dem programmierbaren prozessorgestützten Teilsystem zu empfangen und die Informationen auf dem HUD anzuzeigen.
 
4. System nach einem der Ansprüche 1 bis 3, wobei die computerisierte Brillenvorrichtung (150) des Weiteren ein Mikrofon (159) enthält, das mit der Steuer- und Kommunikationsschaltung (157) wirkverbunden und dafür konfiguriert ist, sprachaktivierte Benutzerbefehlsinformationen zu empfangen und die sprachaktivierten Benutzerbefehlsinformationen drahtlos an die Schweißstromquelle oder an das programmierbare prozessorgestützte Teilsystem zu senden, und/oder wobei die computerisierte Brillenvorrichtung (150) des Weiteren eine Kamera (158) enthält, die mit der Steuer- und Kommunikationsschaltung (157) wirkverbunden und dafür konfiguriert ist, eines oder mehrere von Standbildern und bewegtem Video aufzunehmen.
 
5. System nach einem der Ansprüche 1 bis 4, wobei die Steuer- und Kommunikationsschaltung (157) dafür konfiguriert ist, über einen Drahtloszugangspunkt auf das Internet zuzugreifen.
 
6. System nach einem der Ansprüche 1 bis 5, wobei die computerisierte Brillenvorrichtung (150) des Weiteren mindestens ein an dem Rahmen (151) befestigtes Gehäuse (162) enthält, das eines oder mehrere von der Steuer- und Kommunikationsschaltung (157), dem Mikrofon (159) und der Kamera (158) enthält.
 
7. System nach einem der Ansprüche 1 bis 6, wobei der Rahmen (151) eine Brücke (152) enthält, die dafür konfiguriert ist, auf der Nase des Benutzers getragen zu werden, wobei der Brauenabschnitt (153) mit der Brücke gekoppelt ist und sich von der Brücke fort zu einem ersten, von der Brücke entfernt liegenden Ende erstreckt und dafür konfiguriert ist, über einer ersten Seite einer Braue des Benutzers positioniert zu werden, und wobei ein erster Arm ein erstes Ende enthält, das mit dem ersten Ende des Brauenabschnitts gekoppelt ist und sich zu einem freien Ende erstreckt, wobei der erste Arm dafür konfiguriert ist, über einer ersten Schläfe des Benutzers positioniert zu werden, während das freie Ende in der Nähe eines ersten Ohres des Benutzers angeordnet ist.
 
8. System nach Anspruch 7, wobei die Brücke (152) zur selektiven Positionierung des Brauenabschnitts (153) relativ zu einem Auge des Benutzers einstellbar ist.
 
9. System nach einem der Ansprüche 1 bis 8, wobei die computerisierte Brillenvorrichtung (150) des Weiteren mindestens eine verschriebene optische Linse (163) enthält, die durch den Rahmen (151) an ihrem Platz gehalten wird.
 
10. System nach einem der Ansprüche 1 bis 9, wobei die computerisierte Brillenvorrichtung (150) des Weiteren ein Mikrofon, eine Bewegungserfassungsvorrichtung und/oder eine berührungsempfindliche Benutzerschnittstelle (330) enthält.
 
11. System nach Anspruch 1, wobei die computerisierte Brillenvorrichtung (150) des Weiteren mindestens eine Bewegungserfassungsvorrichtung enthält, die mit der Steuer- und Kommunikationsschaltung (157) wirkverbunden und dafür konfiguriert ist, räumliche Informationen an das programmierbare prozessorgestützte Teilsystem zu übermitteln, wenn ein Benutzer seinen Kopf bewegt.
 
12. System nach Anspruch 1, wobei die computerisierte Brillenvorrichtung (150) des Weiteren eine berührungsempfindliche Benutzerschnittstelle (161) enthält, die mit der Steuer- und Kommunikationsschaltung (157) wirkverbunden und dafür konfiguriert ist, einem Benutzer die Auswahl von Befehlsinformationen und das drahtlose Senden der Befehlsinformationen an das programmierbare prozessorgestützte Teilsystem zu gestatten.
 


Revendications

1. Système de soudage de réalité virtuelle, comprenant :

un casque de soudage de protection ;

un sous-système basé sur processeur programmable (310) ; et

un dispositif de lunetterie informatisé (150) comportant un affichage tête haute (HUD) (156) et une circuiterie de commande et de communication (157) fonctionnellement reliée au HUD (156),

dans lequel le sous-système basé sur processeur programmable (310) et le dispositif de lunetterie informatisé (150) sont configurés en coopération pour fournir un ou plusieurs parmi des images de réalité virtuelle associées à un processus de soudage de réalité virtuelle et des repères et indicateurs virtuels associés à un processus de soudage de réalité virtuelle du HUD (156) ;

dans lequel le dispositif de lunetterie informatisé (150) est configuré pour :

être porté par un utilisateur comme des lunettes sont portées tout en portant également le casque de soudage de protection ; et

communiquer sans fil avec le sous-système basé sur processeur programmable (310) ;

dans lequel le dispositif de lunetterie informatisé (150) inclut en outre une monture (151) configurée pour être portée sur la tête de l'utilisateur ;

dans lequel le HUD (156) est fixé à la monture (151) et est mobile par rapport à la monture par l'intermédiaire d'une rotation autour d'un premier axe qui s'étend parallèlement à une partie de front (153) de la monture (151) .


 
2. Système de soudage à l'arc, comprenant :

un casque de soudage de protection ;

une source d'énergie de soudage (140) ; et

un dispositif de lunetterie informatisé (150) comportant un affichage tête haute (HUD 156) et une circuiterie de commande et de communication (157) fonctionnellement reliée au HUD (156), dans lequel le dispositif de lunetterie informatisé (150) est configuré pour :

être porté par un utilisateur comme des lunettes sont portées tout en portant également le casque de soudage de protection ; et

communiquer sans fil avec la source d'énergie de soudage (140) ;

dans lequel le dispositif de lunetterie informatisé (150) inclut en outre une monture (151) configurée pour être portée sur la tête de l'utilisateur ;

dans lequel le HUD (156) est fixé à la monture (151) et est mobile par rapport à la monture par l'intermédiaire d'une rotation autour d'un premier axe qui s'étend parallèlement à une partie de front (153) de la monture (151) ;

dans lequel la source d'énergie de soudage (140) et le dispositif de lunetterie informatisé (150) sont configurés en coopération pour fournir un ou plusieurs parmi des indicateurs augmentés indiquant une technique de soudage d'utilisateur et des fonctionnalités de séquenceur indiquant un soudage suivant à réaliser sur le HUD.


 
3. Système selon la revendication 1 ou 2, dans lequel la circuiterie de commande et de communication (157) est configurée pour recevoir sans fil des informations depuis la source d'énergie de soudage ou depuis le sous-système basé sur processeur programmable et afficher les informations sur le HUD.
 
4. Système selon l'une des revendications 1 à 3, dans lequel le dispositif de lunetterie informatisé (150) inclut en outre un microphone (159) fonctionnellement relié à la circuiterie de commande et de communication (157) et configuré pour recevoir des informations d'instruction d'utilisateur à commande vocale et transmettre sans fil les informations d'instruction d'utilisateur à commande vocale à la source d'énergie de soudage ou au sous-système basé sur processeur programmable, et/ou dans lequel le dispositif de lunetterie informatisé (150) inclut en outre une caméra (158) fonctionnellement reliée à la circuiterie de commande et de communication (157) et configurée pour capturer une ou plusieurs parmi des images fixes et une vidéo animée.
 
5. Système selon l'une des revendications 1 à 4, dans lequel la circuiterie de commande et de communication (157) est configurée pour accéder à l'Internet par l'intermédiaire d'un point d'accès sans fil.
 
6. Système selon l'une des revendications 1 à 5, dans lequel le dispositif de lunetterie informatisé (150) inclut en outre au moins un boîtier (162) fixé à la monture (151) contenant un ou plusieurs parmi la circuiterie de commande et de communication (157), le microphone (159) et la caméra (158).
 
7. Système selon l'une des revendications 1 à 6, dans lequel la monture (151) inclut un pont (152) configuré pour être supporté sur le nez de l'utilisateur, la partie de front (153) étant couplée au pont et s'étendant à l'écart de celui-ci vers une première extrémité distante de celui-ci et configurée pour être positionnée sur un premier côté d'un front de l'utilisateur, et un premier bras comportant une première extrémité couplée à la première extrémité de la partie de front et s'étendant jusqu'à une extrémité libre, le premier bras étant configuré pour être positionné sur une première tempe de l'utilisateur avec l'extrémité libre disposée à proximité d'une première oreille de l'utilisateur.
 
8. Système selon la revendication 7, dans lequel le pont (152) est ajustable pour un positionnement sélectif de la partie de front (153) par rapport à un œil de l'utilisateur.
 
9. Système selon l'une des revendications 1 à 8, dans lequel le dispositif de lunetterie informatisé (150) inclut en outre au moins un verre optique correcteur (163) maintenu en place par la monture (151).
 
10. Système selon l'une des revendications 1 à 9, dans lequel le dispositif de lunetterie informatisé (150) inclut en outre un microphone, un dispositif de détection de mouvement et/ou une interface utilisateur tactile (330) .
 
11. Système selon la revendication 1, dans lequel le dispositif de lunetterie informatisé (150) inclut en outre un dispositif de détection de mouvement fonctionnellement relié à la circuiterie de commande et de communication (157) et configuré pour fournir des informations spatiales au sous-système basé sur processeur programmable au fur et à mesure qu'un utilisateur bouge la tête.
 
12. Système selon la revendication 1, dans lequel le dispositif de lunetterie informatisé (150) inclut en outre une interface utilisateur tactile (161) fonctionnellement reliée à la circuiterie de commande et de communication (157) et configurée pour permettre à un utilisateur de sélectionner des informations d'instruction et de transmettre sans fil les informations d'instruction au sous-système basé sur processeur programmable.
 




Drawing














Cited references

REFERENCES CITED IN THE DESCRIPTION



This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

Patent documents cited in the description