DETAILED DESCRIPTION
[0020] As mentioned above, computer games, such as video games, have become a popular source of entertainment. Currently, the video output of most computer games is typically displayed on a single display, such as for example a monitor or television (TV). As such, when playing a computer game the user typically just keeps looking at the same spot, namely the single display.
[0021] In some embodiments, the present invention makes computer games and other types of computer simulations more interactive and entertaining by adding an image projection output that is used in addition to the traditional video display output. In some embodiments, images are projected from the handheld controller that is used by the user to control the computer simulation. This allows the user to display the extra projected images on a wall, the floor, the ceiling, or anywhere the user points the handheld controller. For example, the user can project a map on the floor or on a wall in order to explore the town, forest, etc., in the game.
[0022] In some embodiments, holographic images are projected. That is, images projected from the handheld controller may be used to form a hologram. This allows, for example, a person's face or entire body, such as a character in a game, to be projected into the air and suspended there. And in some embodiments, the system also generates audio that is associated with the projected images. This allows, for example, a voice to be added to the hologram of the game character, which in turn allows the hologram to speak to the user to, for example, provide orders to follow the next mission or some other instructions or information.
[0023] Referring to FIG. 1, there is illustrated a block diagram of a system 100 in accordance with an embodiment of the present invention. The system 100 includes a processor based apparatus 102, such as a game console or entertainment system. The processor based apparatus 102 is capable of running a computer simulation, such as a computer game or video game. The computer simulation is controlled at least in part by a handheld controller 104, such as a game controller, game pad, wand, or any other type of handheld controller.
[0024] A display 106 is used for displaying images generated by the computer simulation. The display 106 may comprise any type of display, such as a monitor, TV, or any other type of display. The display 106 may be coupled to, or in communication with, the processor based apparatus 102 via a wired or wireless connection.
[0025] In some embodiments, an image projector 108 is coupled to the handheld controller 104. An image projector is an optical device that projects images onto a surface. A small scale or miniaturized image projector is known as a pico projector, handheld projector, or mobile projector. Some major imager technologies employed by pico projectors include Digital Light Processing (DLP), Liquid Crystal on Silicon (LCoS), and laser. The image projectors discussed herein may comprise any of these types of image projectors, as well as any other types of image projectors.
[0026] In some embodiments, the image projector 108 is coupled to the handheld controller 104 by being built into the handheld controller 104. For example, the image projector 108 may be included and/or mounted in the housing of the handheld controller 104. Or, the image projector 108 may be integrated, incorporated, and/or combined with the handheld controller 104 in some other way. A version of this type of coupling of the image projector 108 to the handheld controller 104 will be discussed below, with an example provided in FIG. 9.
[0027] In some embodiments, the image projector 108 is coupled to the handheld controller 104 by being housed in a unit 110 that is capable of being removably or releasably attached or docked to the handheld controller 104, which is what is illustrated in FIG. 1. For example, the unit 110 and the handheld controller 104 may be configured such that the unit 110 can be docked with the handheld controller 104, and then easily undocked. The unit 110 may be small so that it can be docked or attached to the handheld controller 104 using a mount, holder, bracket, or similar releasable attachment or docking mechanism. In this way, in some embodiments, the image projector 108 is housed in the unit 110 that is configured to be releasably docked to the handheld controller 104. In some embodiments, the unit 110 is operational whether or not it is docked with the handheld controller 104. For example, a stand-alone use of the unit 110 will be discussed below.
[0028] During operation of the system 100, the processor based apparatus 102 runs a computer simulation that is controlled at least in part by the handheld controller 104, which is manipulated by a user. Images generated by the computer simulation are sent to the display 106 where the images are display to the user. In addition, at least one image generated by the computer simulation is sent to the image projector 108.
[0029] In some embodiments, the at least one image generated by the computer simulation is sent to the image projector 108 via wireless streaming. For example, a WiFi or other wireless connection may be used by the processor based apparatus 102 to send the at least one image generated by the computer simulation to the image projector 108.
[0030] Once received, the image projector 108 projects the at least one image generated by the computer simulation. The projection of the image by the image projector 108 is indicated by the beam 109. In the example shown in FIG. 1, the image projector 108 projects the image onto the floor, which is indicated by the image 112. It should be understood, however, that the image 112 can be projected onto any surface, such as a wall or ceiling, or even into the air to form a hologram, as will be discussed below.
[0031] In some embodiments, the unit 110 also includes one or more audio speakers, such as stereo speakers, or an audio output jack (for connection to external speakers) so that sounds can be heard by the user while viewing the projected image 112. For example, the computer simulation may generate one or more audio signals that are associated with the at least one image generated by the computer simulation that is sent to the image projector 108. The processor based apparatus 102 then provides the one or more audio signals to the unit 110 or wherever the audio circuity associated with the projector 108 is located. In some embodiments, the processor based apparatus 102 provides the one or more audio signals to the unit 110 via wireless streaming, such as by the above-mentioned WiFi or other wireless connection. Thus, as is the usual use case, the handheld controller 104 is generally connected to the processor based apparatus 102, such as a game console, via a wireless connection for the gaming control (or more generally, for simulation control). The unit 110 may be connected through another wireless link and stream audio and video (AN) using some compressed data format.
[0032] Thus, the system 100 provides a solution that gives the user a secondary interactive image 112 near or around user. By moving and/or pointing the handheld controller 104, the user can project the image 112 wherever he or she wants, such as on the floor, or on the wall, or on a table, etc. This provides a more entertaining and exciting experience for the user than previous systems in which the user played a game by viewing a single display, such as a single PC monitor or a TV. In such previous systems there was no additional vision involved during the game play, and that disadvantage is solved by the system 100. The system 100 provides the user with a secondary, interactive image/screen in a reasonably compact system. Furthermore, the system 100 provides a compact video/audio system that can be integrated with, or into, an existing handheld controller using projecting technology.
https://patentscope.wipo.int/search...IBLIO&queryString=&recNum=162&maxRec=70416095
