Conferencing system, server, image display method, and computer program product

(54) Title: CONFERENCE SYSTEM, SERVER, IMAGE DISPLAY METHOD, AND COMPUTER PROGRAM PRODUCT (30) Unionist Priority: 07/08 / 2007JP 2007-205647 (73) Holder (s): Seiko Epson Corporation (72 ) Inventor (s): Noboru Inoue (57) Summary: conference system, server, IMAGE DISPLAY METHOD, AND COMPUTER PROGRAM PRODUCT. The conference system consists of computers, a moderator computer, and a projector connected to a network. The moderator's computer receives image data from the computers, and generates from the same synthesized image data, which is transmitted to the projector for displaying the synthesized image. The moderator's computer has the ability to switch the image being projected by the projector from the synthesized image to an image processed by one of the computers or the moderator's computer. With such an arrangement, using existing hardware resources it will be possible to display in a single split screen video the images processed by the terminals connected to the network. Additionally, it will be possible to smoothly switch between screen displays, and reduce the load on the screen display operator in a networked conference system.

<td colspan="2">SC11 ^sP¹ SC12 (J í</td>

<td></td><td></td>

<td></td><td> )</td>

<td>SC14</td><td>l SC13</td>

<td></td><td>^ PRI =, 0</td><td> □5 [=1 0</td><td>"and</td><td>^ -PCm LAN</td>

<td>ΪΟΙ5 CZ3 O</td><td>IO E O __1 1 = -, - BBÚ ç</td><td>Qi ç -n -BSaaQ e</td><td>| Q</td><td>| O</td>

\ \ \ \ \

PCI PC2 PC3 PC4 PC5

ΡΙ0803498-2 “CONFERENCE SYSTEM, SERVER, IMAGE DISPLAY METHOD, AND COMPUTER PROGRAM PRODUCT”

CROSS REFERENCE TO RELATED ORDERS

This application claims priority from Japanese application P2007-205647A 5 filed on August 7, 2007, the content of which is incorporated by reference in that application.

BACKGROUND

1. Field of the Invention

The present invention relates to a conference system that includes a terminal, a server, and an image display device connected via a specified communication channel.

2. Description of the Related Art

Conference systems in which multiple PCs are connected to a projector have been developed in recent years. Such a conference system allows multiple computer display screens to be projected simultaneously through a split screen display; this is useful in situations such as conferences or seminars where you want to have a discussion while visually comparing data stored on several different computers. Known technologies related to such conference systems include those disclosed, for example, in JP-A-2004-54134.

The Cited Patent Reference, above, discloses a technology by which screen capture images from a number of terminals connected to a network are combined by a projector and projected as a single, split-screen display.

However, conference systems employing this type of projector require the use of a special projector, so that if a user who already has a conventional projector intends to participate in such a conference system, it will require the purchase of a new special projector, at considerable expense to the user. In addition, in cases where a user operating the projector intends to modify the currently projected split screen display, for example, to switch one of the terminal screens shown in the split screen display to the screen of another terminal that is not currently being displayed, there may be considerable waiting time for the projector to create and project the new combined image. Additionally, in cases where a user operating the projector intends to present an image for projection by the projector, it will be necessary to operate two devices, that is, the projector plus a terminal, thus imposing a considerable operational load on the user. These problems are not limited to conference systems that employ projectors, and are generally common in conference systems where displays on the terminal screen are shown on display devices of various types.

With the aforementioned in view, an objective of the present invention is to provide a conference system that, using existing hardware resources, is capable of displaying in a single split screen display the images that are processed by the terminals connected by a determined communication channel. It is another objective to provide a conference system capable of smoothly switching between on-screen displays. It is an additional objective to reduce the burden imposed on the operator by a screen display on a conference system that employs a specific communication channel.

SUMMARY

The present invention relates to obtaining the objectives mentioned above and / or optional objectives, at least in part, according to the following modes. An aspect of the conference system having a terminal, a server, and an image display device connected via a specified communication channel, wherein the terminal includes a first transmission unit which transmits to the server, via the channel determined communication, terminal image data representing an image processed by the terminal;

the server includes: a receiving unit that receives the terminal image data transmitted from the terminal, an image synthesis unit that generates synthesized image data for the purpose of displaying a synthesized image that was created by synthesizing the image represented by the image data terminals received with another image, and a second transmission unit that transmits the synthesized image data thus generated as data to display to the image display device via the determined communication channel; and the image display device includes a display unit for receiving the data for displaying and presenting the data as an image.

In the conferencing system of the model above, the server generates synthesized image data for the purpose of displaying a synthesized image created by synthesizing an image represented by the terminal image data received with another image, and transmits the synthesized image data to the image display device. Consequently, the image display device will be able to display a synthesized image simply by receiving and displaying the synthesized image data, thereby enabling an existing image display device, without any special split screen display functionality, display images processed by the terminals connected to a specific communication channel, in the form of a single split-screen display. The term “determined communication channel” is used here in a broad sense including not only various types of networks, such as local area networks, remote area networks, the Internet and so on, but also communication units of various types , such as communication units having direct local connections between devices rather than network connections.

In addition to the modality as a conference system described above, the present invention can also be incorporated as a server for displaying an image on an image processing device; an image display method for displaying images by a computer, or a computer program for displaying images. The computer program can be recorded on a computer-readable storage medium. Recording media that can be used for this purpose include floppy disks, CD-ROM, DVD-ROM, magneto-optical discs, memory cards, hard drives and other media.

BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 is an illustration of a conference system configuration 10; Figure 2 is an illustration of a general configuration of PC1-PC5 computers; Figure 3 is an illustration of a general configuration of a moderator's PCm computer;

Figure 4 is an illustration of a general configuration of a PR1 projector;

Figure 5 is a flow chart illustrating, in the process of connecting computers

PC1-PC5 and the moderator's PCm computer, the flow from the PC1PC5 computers side;

Figure 6 is a flow chart illustrating, in the process of connecting computers

PC1-PC5 and the moderator's PCm computer, the flow through the moderator's PCm side;

Figure 7 is an illustration showing a specific example of an hourly profile 33;

Figure 8A is an illustration showing a specific example of an hourly profile 83;

Figure 8B is an illustration showing a specific example of a class 84 composition profile;

Figure 9 is an illustration showing, by way of an embodiment, an example of a flow from a split screen display switching process to switch screen display using the conference system 10;

Figure 10 is an illustration showing, through a modality, an exemplary flow of a split screen display switching process for switching the screen display using the conference system 10;

Figure 11 is an illustration showing an exemplary W400 Projector Selection window for making screen and projector display adjustments;

Figure 12 is an illustration showing an exemplary Operation window of the Pro4 projector W500 to perform operation of the projector;

Figure 13 is an illustration showing an exemplary display shown when using the W500 Projector Operation window;

Figure 14 is an illustration showing, through an alternative modality, an exemplary flow of a split screen display switching process for screen display switching using the conference system 10;

Figure 15 is an illustration showing, through an alternative modality, an exemplary flow of a split screen display switching process to switch the screen display using the conference system 10; and

Figure 16 is an illustration showing an exemplary W500 Projector Operation window in an alternative mode.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The modalities of the present invention will now be described.

A. Conference System 10 Configuration:

TO 1. General System Configuration:

A configuration for a conference system 10, according to this modality, is illustrated in Figure 1. This conference system 10 is an image display system capable of simultaneously displaying, through a projector, a multi-screen display terminals; the system includes PC1 to PC5 computers, a moderator PCm computer, and a PR1 projector which are connected on a specific communication channel. In this mode, computers PC1 to PC5, the moderator's PCm computer, and the PR1 projector are connected to a local area network LAN. Although not shown in the drawing, other devices equivalent to the moderator's PCm computer and the PR1 projector are also installed on the local area network LAN.

The method of connecting the PC1 to PC5 computers, the modeler PCm computer, and the PR1 projector is not limited to the mode described above, and several other connection methods could be established depending on the working environment, required communication speed, and others considerations. For example, there could be a local connection, such as a D-sub or USB cable connection, between the moderator's PCm computer and the PR1 projector. Connections are not limited to wired connections, and wireless connections can also be employed. Of course, connections via the Internet would also be possible.

While leaving a more detailed discussion for later, the PR1 projector is capable of displaying, through projection and an SC1 screen, a synthesized image that was created by the moderator's PCm computer by synthesizing four different images into a single screen image. Here, the four areas of the split screen display on screen SC1 will be denoted as split screen areas SC11 to SC14, as shown in the drawings.

A-2. General Configuration of PC1-PC5 Computers:

Computer PC1 in conference system 10 is a personal computer on which specific programs have been installed, and is provided for use by a particular Student A. The general configuration of computer PC1 is illustrated in Figure 2. Computers PC2 through PC5 which have been provided for use by Students B to E, they are comparable in configuration to the PC1 computer and as such do not need to be discussed here. As illustrated, computer PC1 includes a CPU 20, a hard drive 30, a ROM 36, a RAM 38, a network interface 41, an input system 51, a VRAM 61, a graphics controller 63, and a video 65, which are interconnected respectively via a bus.

CPU 20 performs control of computer PC1 by loading RAM 38 of firmware or an OS which is stored on hard drive 30 or ROM 36 and then performs the same. In addition, by executing the programs stored on the hard disk drive 30, the CPU 20 can function as a data transmission module 21 or as a communication module 22. These function modules will be discussed in detail later.

Hard disk drive 30 contains memory areas reserved for storing, in addition to the IP address of computer PC1, a server name / address management table 31, a server name profile 32, and an hourly profile 83 These elements will be discussed in detail later. These memory areas are not limited to being provided on hard drive 30 and can instead be reserved on EEPROM, a type of non-volatile, rewritable memory.

The network interface 41 constitutes the interface for connection to the local area network LAN; computer PC1 is connected to the local area network LAN through this network interface 41.

Input system 51 includes a keyboard and pointing device (a mouse in this example). The graphics controller 63, using VRAM 61 as a store, displays images that should be shown on the display 65.

A-3. General configuration of the Moderator's PCm computer:

The moderator's PCm computer in conference system 10 is a personal computer on which the determined programs have been installed, and is provided for use by an M Instructor. In the modality, that moderator's PCm computer corresponds to the server element in the claims. The general configuration of the moderator's PCm computer is illustrated in Figure 3. As illustrated, the moderator's PCm computer includes a CPU 70, a hard drive 80, a ROM 86, a RAM 88, a network interface 91, a USB interface 93, an input system 101, a VRAM 111, a graphics controller 113, and video 115, which are interconnected respectively via a bus.

By executing the programs stored on the hard drive 80, the CPU 70 can function as a data communication control module 71, an image synthesis module 72, a synthesized image reception module 73, a reception module image switch 74, GUI control module 75, communications module 76, a transmission instruction receiving module 77, and a completed synthesis alert module 78. These function modules will be discussed in detail later. The transmission instruction reception module 77 and the completed synthesis alert module 78 are function modules provided in an alternative mode, described later.

Hard drive 80 contains memory areas reserved for storage, in addition to the moderator's PCm computer IP address, a client name / address management table 81, a client name profile 82, an hourly profile 83, and a class 84 composition profile. These elements will be discussed in detail later. Some GUI programs, discussed later, are also stored. They will be discussed in detail later. These memory areas are not limited to being provided on hard drive 80 and, instead, they can be reserved on EEPROM, a type of rewritable, non-volatile memory.

The USB 93 interface is a USB-compatible interface for connecting to the PR1 projector, and the moderator's PCm computer can be connected to the PR1 projector with a USB cable.

ROM 86, RAM 88, network interface 91, input system 101, VRAM 111, graphics controller 113, and video 115 are similar in model to those of PC1-PC5 computers, and need not be described in detail.

A-4. General Configuration of the PR1 Projector:

The PR1 projector in the conference system 10 is a conventional projector without any special split screen display capabilities; its general configuration is illustrated in Figure 4. As illustrated, the PR1 projector includes a CPU 120, a ROM 136, a RAM 138, a network interface 141, a USB interface 143, a VRAM 151, a graphics controller 153, and a projection section 155, which are interconnected, respectively, via a bus.

By loading a program stored in ROM 136 in RAM 38 and executing it, CPU 120 can function as a data reception module 121. This function module will be discussed in detail later.

The network interface 141 is an interface for connection to the local area network LAN; the PR1 projector is connected to a local area network LAN through this network interface 141. The USB interface 143 is a USB compatible interface for connection to the moderator's PCM computer, and the PR1 projector is connectable to the moderator's PC computer with a USB cable.

Using VRAM 151 as a store, the graphics controller 153 controls the projection section 155 to project images. The projection section 155 is an LCD projection system that displays images on the SC1 screen by projecting light that has passed through the liquid crystal panels to each of the RGB color components. Although LCD technology is used in this modality, no specific limitations to that technology are inferred in this way, and it would be possible to use other technologies such as CRT, DLP, LCOS, or GLV technology.

B. Method of Using the Conference System 10:

The following specific discussion of the method of using the conference system 10 provides for a conference system 10 adapted for use in the classroom. In the example below, it is assumed that during a class Instructor M in his assignment as the class facilitator will control the moderator's PCm computer, and through the PR1 projector will display on SC1 screen in full screen display any of the display images in PCT1-PCT5 screens shown in video 65 of each of the PCT1-PCT5 computers being used by AE Students, or a PCTm screen display image shown in video 115 of the moderator's PC computer; or a split screen display showing screen display images, selected from the PCT1-PTC5 and PCTm screen display images. The PCT1-PTC5 and PCTm screen display images are images that show the data created by Students AE and Instructor M respectively; depending on the circumstances of the class, Students AE and Instructor M can alternate explaining the data they individually created.

B-1. Initial Configuration for Use:

The initial configuration for the purpose of using the conference system 10 will now be described. Here, initial configuration refers to the initial configuration for the purpose of communication between PC1-PC5 computers and the PCm moderator computer. The initial configuration process starts when Instructor M first starts a specific software application, and each Student AE then starts the specific software application.

When the aforementioned software application has started, CPU 20 from each of the PC1-PC5 computers will issue a search command for global transmission to the local area network LAN. Meanwhile, the CPU 70 of the moderator's PCm computer having received the command and search will respond to each of the PC1PC5 computers with the computer name (instructor name) and IP address of the moderator's PCm computer. PC1-PC5 computers, after receiving the computer name and IP address, will register the information in the server name / address management table 31.

The CPU 20 of each PC1-PC5 computer will then individually transmit the computer name (student name) and the IP address of your PC1PC5 computer to the moderator's PCm computer. Upon receipt of these computer names and IP addresses, the moderator's PCm computer will register them in the customer name / address management table 81.

Subsequently, by querying the server name profile 32 in which the instructor's name is registered and querying the server name / address management table 31, mentioned above, switches PC1-PC5 will identify the IP address of the PCm computer of the moderator and establish communication. Similarly, by querying the client name profile 82 and the client name / address management table 81, the moderator's PCm computer will identify the IP addresses of the PC1-PC5 computers and establish communication. In this modality, this initial configuration process is designed to be performed whenever the software application, previously mentioned, is started to deal with the occurrences where a new Student was added or, an IP address was changed; however, it is possible to dispense with this initial configuration update in cases where there has been no change in the registry for a specified period of time. The initial setup process described above can also be designed to be introduced by Instructor M and Students AE using input systems 51 and 101.

In this modality, it was assumed that the IP addresses of the PC1-PC5 computers and the moderator's PCm computer were saved in the respective hard drives of the computers being configured in advance by Students AE and Instructor M; however, no specific limitation is sought in such a way. For example, it would be acceptable, prior to the initial configuration described above, for a DHCP server on the local area network LAN to receive IP address requests transmitted globally by the moderator's PC1-PC5 computers and the PCm computer, and to individually assign the IP addresses.

B-2. Connection Process:

Figure 5 and Figure 6 illustrate the flow of process establishment connections between PC1-PC5 computers and the moderator's PCm computer. Figure 5 illustrates the process performed by the PC1-PC5 side by CPU 20 through a process in its assignment of communication module 22. Figure 6 illustrates the process performed by the PCm side of the moderator by CPU 70 through a process in its assignment of communication module 76. The description below assumes that AE Students have been assigned computers for their exclusive use. These processes will be initiated by activating the software application previously mentioned9 and completing the initial configuration.

When the connection process is started, first CPU 20 of each of the PC1-PC5 computers will load the hourly profile 33 stored on the hard drive 30, as illustrated in Figure 5 (step S200).

A specific example of the hourly profile 33 is illustrated in Figure 7. The hourly profile 33 is a profile that establishes access points on an hourly basis; in this case, lesson time partitions for first period to fourth period, from Monday to Thursday, are associated with the names of the class instructors, being performed on those class time partitions. That is, a third hourly profile 33 represents a schedule of classes for AE Students, specifying, for example, that the first period on Mondays will be taught by Instructor M, and that the third period on Tuesdays will be taught. taught by Instructor N. This hourly profile 33 will have been entered in advance by each Student AE using input system 51, and stored on hard drive 30.

When the hourly profile 33 has been loaded, CPU 20 will compare the current time with the hourly profile 33 and decide if there are any profile data corresponding to the current time (Step S201).

As a result, if corresponding profile data is available (Step S201: YES), it will mean that class attendance has been scheduled for the time in question, and CPU 20 will accordingly request a connection to the computer (in this mode, the PCm computer the Moderator) of the Instructor in question (in this modality, Instructor M), at the time in question (Stage S202). Although not shown in Figure 1, if as Instructor M, Instructors N to Q shown in Figure 7 also have individually assigned moderator computers that are connected to the local area network LAN, and if there are times when other classes will have been programmed, requests will be made to connect instructor computers N to Q. On the other hand, if there is no corresponding profile data (step S201: NO), it means that no class has been scheduled for the time in question, and the process will end.

However, when the connection process is initiated at the end of the moderator's PCm computer, first, as shown in Figure 6, CPU 700 will load the hourly profile 83 and the class 84 composition profile stored in the hard disk 80, as shown in Figure 6 (step S221).

A specific example of this hourly profile 83 is illustrated in Figure 8A. The hourly profile 83 is a profile that establishes access points on an hourly basis; in this case, lesson time partitions for a first period to the fourth period, from Monday to Friday, are associated with the names of the lessons to be taught in those lesson time partitions. That is, the hourly profile 83 represents a teaching schedule for Instructor M, specifying, for example, that he will teach in Class 1 during the first period on Mondays, and will teach in Class 2 during the second period on Mondays. fairs.

A specific example of the Class 84 composition profile is illustrated in Figure 8B. The class 84 composition profile is a profile indicating the composition of the classes on an individual education basis; here, the names of the students composing the class in question were associated with Class 1 to Class 7 respectively.

This hourly profile 83 and the class 84 composition profile will have been introduced in advance by Instructor M, and stored on hard drive 80.

When the hourly profile 83 and the class 84 composition profile have been loaded, CPU 70 will decide on an ongoing basis whether connection requests were made by AE students, that is, by PC1-PC5 computers (step S222 ).

As a result, if no connection request was made (step S222: NO), it will wait for a connection request. If on the other hand it is decided that a connection request has been made (step S222: YES), the CPU will consult the hourly profile 83 and the class 84 composition profile to decide whether the Student making the connection request is a Student belonging to the class corresponding to the current time specified in the hourly profile 83 (step S223).

As a result, if the Student belongs to the class (Step S223: YES), CPU 70 will allow the connection in response to the connection request from the student, and a connection will be established (step S224). If, on the other hand, the Student does not belong to the class, since the Student in question is not authorized to participate in the lesson being taught at that time, CPU 70 will deny the connection request from the Student (Step S225), as a result of that the process will return to Step S222 mentioned above and will wait for a new connection request from a student. In this way, the connections between the PC1-PC5 computers and the moderator's PCm computer are established through the local area network LAN.

Although this modality assumes that AE Students were individually assigned PC1-PC5 computers for their own exclusive use, in situations where a single computer will be shared by more than one Student, it would be possible to employ an arrangement so that, before step S200 previously mentioned, CPU 20 will prompt the Student to enter his name, and in step S202 previously mentioned it will transmit the Student's name, along with the connection request, to the moderator's PCm computer.

In addition, while in this modality both PC1-PC5 computers in their assignment, and the moderator's PCm in their assignment of server, respectively, store profiles that contain associations between temporal conditions and access points, it would also be acceptable to employ an arrangement in which such profiles are stored only by one or the other. Where profiles are stored only by the moderator's PCm computer, using an arrangement whereby PC1-PC5 computers automatically transmit connection requests globally to the local area network LAN, the moderator's PCm computer will be able to consult the profile hourly 83 and in the class 84 composition profile, and allow connections only to the PC1-PC5 computers that match these profiles, thereby enabling connections between PC1-PC5 computers and the moderator's PCm computer to be established automatically.

Additionally, it would be acceptable to employ an arrangement whereby if the moderator's PCm computer denies a connection in step S225, the PC1-PC5 computer to which the connection was denied will be notified of the denied connection. In doing so, Student AE can quickly be informed that he is not authorized to attend the class in question.

B-3. Split Screen Display Switching Process:

Figure 9 and Figure 10 illustrate an exemplary flow of a split screen display switching process in which the conference system 10 of the modality is used to project the screen displays of PC1-PC5 computers onto the SC1 screen as a display image. split screen while switching between on-screen displays. The right column in Figure 9 and Figure 10 illustrates the operations performed by Instructor M using the moderator's PCm computer, to specify on-screen displays for projection onto the SC1 screen. The middle column in Figure 9 and Figure 10 illustrates the moderator's PCm computer processes in response to operations performed by Instructor M, shown in the right column, and PC1-PC5 computer processes and the PR1 projector in response to computer processes PCm of the moderator. The left columns in Figure 9 and Figure 10 illustrate the images projected on the screen at each stage of the processes shown in the middle columns.

This process will be initiated through a projected image instruction operation performed by Instructor M on the moderator's PCm computer. In this modality, the instruction operation is that instructing the TR1 projector to project display images on the PCT1-PCT4 screen of the PC1-PC4 computers, in the form of four images in split screen (Operation 0360).

Operation 0360 is specified using input system 101, and a GUI (graphical user interface) that is displayed on the moderator's PCm display 115. A specific example of the GUI is described below. On the moderator's PCm computer, when the aforementioned software application is activated, the CPU 70 will use the graphics controller 113 to bring to the display 115 a window for selecting the projector and for making on-screen display settings. Figure 11 illustrates a Selection window.

W400 projector as an example of such a window. The W400 Projector Selection window includes a 410 projector selection sub-window and a W420 screen display configuration sub-window.

The projector selection sub-window 410 displays a list of the projectors connected 5 to the moderator's PCm computer. The projectors shown here are projectors whose connection to the moderator's PCm computer was automatically recognized through plug-and-play. Figure 11 illustrates the PR1 projector selected as the projector for use between the connected PR1 and PR2 projectors. Although not shown in Figure 1, for the purposes of this example, the PR2 projector is supposedly connected to the local area network LAN through a configuration similar to that of the PR1 projector. If a projector is located on the local area network LAN, the list of projectors previously mentioned in the projector selection sub-window 410 will show the results of a search for CPU 70 for projectors when the software application is activated; however, by clicking on a B412 Search button it will be possible to search again in the direction of connected projectors.

The W420 screen display configuration window shows display options for images to be displayed on the SC1 screen by the PR1 projector. In the example in Figure 11, the options are full-screen, two-screen, and four-screen; of these, the option to display on four screens is illustrated as having been selected. The displays on two screens, and on four screens, represent the display options so that different images will be displayed simultaneously in the split screen display. Upon selection^k between these display modes it is a simple matter to switch between split screen and full screen view; a detailed discussion will follow shortly thereafter. The options for displaying in split screen are not limited to displaying two screens and displaying four screens shown here as an example; of course, a display of three screens, or a display of five or more screens, would also be acceptable. An arrangement that additionally allows the selection of multiple split screen display modes when displaying two screens, such as placing split screens (that is, whether the two screens will be displayed horizontally or if the two screens will be displayed vertically) or scaling individual split screens would also be acceptable.

When the PR1 projector and the four screen display have been selected as mentioned above and an OK B422 button has been clicked, CPU 70, through a process in its assignment of GUI 75 control module, will load between a number of programs GUI stored on hard drive 80 the GUI program that corresponds to the selected four screen display, and using the graphic computer 113 will produce a projector operation window on display 115. Figure 12 illustrates a W500 Projector Operation window as an example of such a window. The W500 Projector Operation window includes a W510 moderator indicator sub window, a W520 particle indicator sub window, a W600 Projector Operation sub window, and a W700 preview sub window.

The moderator indicator sub window W510 shows as the moderator's name the default user name of the moderator's PCm computer. Where the moderator's PCm computer is shared among multiple users, the moderator may be prompted to enter his name when activating the software application.

The W520 participant indicator sub-window shows a list of computers enabled for projection by the PR1 projector, as well as the status of each one. A projection-enabled computer refers to a computer with which a connection to the moderator's PCm computer was established in step S224 mentioned above and the moderator's PCm computer. In the W520 sub-window, computers are designated by the user name of the computer in question, for convenience of identification. Status refers to information indicating whether a computer is currently being designed. In the example in Figure 12, the W510 moderator indicator sub window displays the moderator's name “Instructor M and the W520 participant indicator sub window displays“ Student AE ”using PC1-PC5 computers. As it is sufficient that the W510 moderator indicator sub-window and W520 participant indicator sub-window uniquely identify the moderator and participants, computer names or models, etc., could instead be displayed.

The W600 Projector Operation sub-window includes a W610 upper left screen sub-window, a W620 upper right screen sub-window, a W630 lower right screen sub-window, and a W640 lower left screen sub-window. The reason four screen sub-windows are provided here is that “four-screen display” was selected from the W420 screen display configuration sub-window discussed previously; if “two-screen display” had been selected, the number of screen underlines would be two, and if “full-screen display” had been selected, the number of screen underlines would be one. That is, the number and placement of the screen sub-windows provided in the W600 Projector Operation sub-window will correspond to the split-screen display shown on screen SC1. In this modality, screen sub-windows are associated with a specific number of divided areas and their placement within the split screen display; however, no specific limitations are imposed in this way and the sub-windows can instead be associated with several other split-screen views. For example, where constituent areas of split-screen, individual composing the split-screen display are shown with different-colored screen edges, the colors of the corresponding screen underlines could be associated with the colors of those edges; or where individual, split-screen constituent areas differ from one another in shape or size, the size or shape of the corresponding screen sub-windows could be associated with the shape or size of those divided-screen constituent areas.

The upper left screen subwindow W610 includes a D611 projector user indicator field; u Project button B613; an Exit button B614; and a B615 Full Screen Display button. The D611 projector user indicator field is the field indicating the computer user that corresponds to the image to be displayed in the upper left split screen display area (the SC11 split screen constituent area). The Project B613 button and the Exit B614 button are control buttons used to start and stop the projection of a determined image on the left, top, split-screen display area, regardless of other split-screen display areas. For example, with “Student A” selected in the participant indicator sub-window W520 as illustrated in Figure 12, by clicking the Project B616 button in the upper left screen sub-window W610, “Student A” can be shown in the user indicator field of the D611 projector, and the PCT screen display image 1 of the PC1 computer, which is being used by Student A, can be displayed in the left, top, screen area on the SC1 screen, that is, the constituent area of ​​SC11 split screen. Then, by clicking the Exit button B614, the indication of “Student A” will disappear from the D611 projector user indicator field, and the PCT1 screen display image will disappear from the SC11 split-screen constituent area. In another possible arrangement, the operation of selecting “Student 1” from the W520 participant indicator sub-window and assigning the PCT1 screen display image to the SC11 split-screen constituent area from the W600 Projector Operation sub-window can be performed by action dragging and dropping “Student A” into W610 on the W520 participant indicator sub-window, rather than clicking the Project B613 button.

The B615 Full Screen Display button is a button used to switch between the split screen display in four screens and the full screen display. For example, if the four-screen split screen display is currently being displayed on the SC1 screen, clicking the Full Screen Display button B615 will switch the image displayed in the left, top, split screen area to full screen display. . The action of clicking the B615 Full Screen Display button again will switch back from the full screen display to the original four screen split screen display. Since the upper right screen windows W620W640 are similar to the upper left screen window 610, they will not be discussed here.

The W600 Projector Operation sub-window includes a PLAYBACK B601 button, a STOP B602 button, and a PAUSE B603 button to control the projection operation of the PR1 projector. These buttons are used to perform collective operations on images transmitted to the PR1 projector by the moderator's PCm computer, and they allow images projected by the PR1 projector to be played, stopped, or paused through collective operations, regardless of whether the SC1 screen display it is currently a split screen view or a full screen view.

The W700 Preview sub window is an area that, when any of the AE Students displayed on the W520 participant indicator sub window has been selected, provides a preview of the PCT1-PCT5 screen display image that corresponds to the selected student, regardless the image projected by the PR1 projector; it is possible to enlarge or reduce the display using an Enlarge B701 button or a Reduce B702 button provided for this purpose. The preview function can employ, for example, image data with reduced data size that was received from the PC1-PC5 computers by the moderator's PCm computer by sending data transmission requests to the PC1-PC5 computers when students AE are selected from the W520 participant indicator sub window.

The W500 Projector Operation window provided with these sub-windows also includes a Select Projector B501 button and a B502 Configuration button. The Select Projector button B501 is a button to select a projector and to reset the screen display; clicking this button will bring up the Project Selection B400 window discussed above. Consequently, by clicking the Select Projector B501 button to display the W400 Projector Selection window, it will be possible for Instructor M to select a projector or modify the screen display settings even when conference system 10 is currently in use. The Configuration button B502 is a button for configuring settings such as when using the input history for the PR1 projector.

When the W400 Projector Selection window has been presented by clicking the Select Projector B501 button, and the screen display settings have been changed, as discussed above, the W500 Projector Operation window subsequently displayed will change to reflect these changes. For example, if from the W400 Projector Selection window an operation is performed to switch from four-screen display to two-screen display, CPU 70 through a process in its assignment of GUI control module 75 will load between GUI programs stored on hard drive 80 the GUI program that corresponds to the display on two screens, and will display the W500 Projector Operation window which now includes a W600 Projector Operation sub-window made up of two screen sub-windows. Where, the screen sub-windows have been associated with the split screen display color, format or size display modes as mentioned above, the W600 Projector Operation sub-window can be modified to reflect changes in the display mode.

In another possible arrangement, the W610-W640 screen sub-windows that make up the W600 Projector Operation sub-window display thumbnails that the 700 CPU created based on the image data for display in the corresponding split-screen display area and stored in RAM 880 . For example, the W610-W640 screen sub-windows can be provided with display fields to display the thumbnails, in locations that will not interfere with the buttons, etc .; or semi-transparent thumbnails created by decreasing the luminance signal strength can be displayed superimposed on the buttons etc. This will make it easier to check the relationships between split-screen display areas and the W610-W640 screen underlines, providing simpler operation.

The discussion now returns to Operation 0360. Using the GUI described above, Instructor M selects “Student A” from the W520 participant indicator sub-window, and after confirming the content of the PCT 1 screen display image displayed in the W700 preview sub window, click on the Project B613 button on the screen sub-screen, left, top W610. Similarly, when BD Students have been selected and the content of the PCT2-4 screen display images displayed in the W700 Preview window has been confirmed, the Instructor will click on the Project B623-B643 button on each of the corresponding under windows. screen, right, top, W620-W640. The purpose of this operation is to instruct the projection of the PCT1-PCT4 screen display images of the PC1-PC4 computers into a four-screen split-screen display by the PR1 projector. These instructions will be processed by CPU 70 through a process in its assignment of synthesized image reception module 73.

When the split screen display command has been received, CPU 70 on the moderator's PCm computer will send a sequence of data transmission requests to PC1-PC4 computers (Step S300).

However, after receiving the data transmission request sent by the moderator's PCm computer (Step S320), the CPU 20 of each of the PC1-PC4 computers, through a process in their assignment of data transmission module 21, it will transmit to the moderator's PCm computer the image data of the PCT1-PCT4 screen display image displayed in his individual video 65 (Step S321). This image data from the PCT1-PCT4 screen display images represents the image data (here, RGB image data) that was saved in RAM 61 of the PC1PC4 computer at the time the data transmission request was received, and will be transmitted along with the configuration information to the graphics controller 63 necessary for the image data to be displayed as an image. The configuration information for the graphics controller 63 does not need to be transmitted if the graphics controller 63 of each of the PC1-PC4 computers, the graphics controller 113 of the moderator PCm computer, and the graphics controller 153 of the PR1 projector have standardized configurations.

However, after receiving transmissions from PC1-PC4 computers, the CPU 70 of the moderator's PCm computer through a process in its assignment of data communication control module 71 will receive the image data from the display images in PCT1-PCT4 screen, transmitted by PC1-PC4 computers respectively, and save them in RAM 85 in association with the computer name (Step S301). Through a process in its assignment of the image synthesis module 72, the CPU 70 will then generate synthesized image data in RAM 85 representing a synthesized image of the PCT1-PCT4 screen display images (step S302).

When the synthesized image data has been generated, through a process in its assignment of data communications control module 71, the CPU 70 will transmit the synthesized image data from the PCT1-PCT4 screen display images to the PR1 projector (Stage S304).

In the PR1 projector, however, through a process in its assignment of data reception module 121, CPU 120 will receive the synthesized image data from the PCT1-PCT4 screen display images, and will record them in VRAM 151. The graphics controller 153 will then read the image data from VRAM 151 and project the image on the SC1 screen using the projection section 155 (Step S340). Thus, as shown in the left column in Figure 9, a screen divided into four screens, showing the respective display images on the PCT1-PCT4 screen, will be displayed on the SC1 screen.

At this point, the W500 Projector Operation window discussed above will assume a condition like the one illustrated in Figure 13. As illustrated, in the W520 participant indicator sub-window, the status “Currently projecting” is shown to AB Students. In the W600 Projector Operation sub-window, “AD Students” are shown respectively in the D611-D641 projector user indicator fields. In the W700 Preview sub-window, the PCT4 screen display image that corresponds to Student D last selected is shown in the W520 participant indicator sub window.

In the aforementioned Step S302 and Step S304, the synthesized image data was transmitted after CPU 70 received the image data from all PC1-PCT4 computers and generated the synthesized image data; however, the generation and transmission of the synthesized image data can also occur at certain time intervals. In the case mentioned first, the display image in a screen divided into four screens will suddenly appear on screen SC1; while in the case mentioned last, the images will be displayed progressively during the generation of the split screen display in four screens.

Next, to provide Student A with a more detailed explanation of the PCT1 screen display image, Instructor M will operate input system 101 to instruct alternating the image projected on the SC1 screen from the split screen display image into four screens of the PCT1-PCT4 screen display images for a full screen display of the PCT1 screen display image of the PC1 computer (operation 0361). Specifically, from the W500 Projector Operation window displayed on screen 115 of the moderator's PCm computer, Instructor M will click on the View Full Screen button B615 on the upper left screen subwindow W610.

Upon receipt of this instruction, on the moderator's PCm computer, through a process in its assignment of image switching reception module 74, CPU 70 will receive the instruction; and through a process in its assignment of data communication control module 71 it will transmit the image data from the PCT1 screen display image recorded in RAM 85 in association with the computer name PC1 to the PR1 projector (Step S305).

In the PR1 projector, however, CPU 120 through a process in its assignment of data reception module 121 will receive the image data, from the PCT1 screen display image, sent by the moderator's PCm computer, and in the same way as in the step S340 discussed earlier, will project the image on the SC1 screen (Step S341). When doing so, as shown in the left column of Figure 9, the PCT1 screen display image will be displayed in full screen view on the SC1 screen. In doing so, it will be possible, for example, for Student A, who is using the PC1 computer, to show the other students the display image on the PCT1 screen which is now displayed remarkably on the SC1 screen, while at the same time explaining the image PCT1 screen display in detail while checking the video content 65 of the PCT1 computer.

Next, Instructor M will project the PCT1 screen display image in full screen display on SC1 screen, and while Student A is explaining the PCT1 screen display image will control input system 101 to instruct the creation of data from synthesized image in which, from the synthesized image data of the PCT1-PCT4 screen display images, the PCT5 screen display image is exchanged with the PCT2 screen display image (Operation 0362). Specifically, in the W500 Projector Operation window shown on video 115 of the moderator's PCm computer, Instructor M will click on the Exit B624 button on the upper right screen subwindow W620, which corresponds to the split screen display area of ​​the screen display image PCT2; and then from the W520 participant indicator sub window, select “Student E” and click the Project B823 button on the upper right screen sub window W620. This operation takes place in preparation for the split screen display of the PCT1 screen display images, 5, 3, and 4 after the explanation of the PCT1 screen display image has been completed.

Upon receipt of this instruction, the CPU 700 of the moderator's PCm computer, through a process in its assignment of synthesized image reception module 73, will receive the instruction, and by consulting the client name profile 82 and the profile hourly 83 will identify the IP address of the other device, and send a data transmission request to the PC5 computer (Step S306).

However, upon receipt of the data transmission request sent by the moderator's PCm computer (Step S322), CPU 20 of the PC5 computer through a process in its assignment of data transmission module 21 will transmit the image data from the image PCT5 screen display currently shown on video 65 of the moderator's PCm computer (Step S323). In consideration of communications loaded on the local area network LAN, the transmission of this image data in step S323 and step S321 can occur in a compressed format such as JPEG.

However, after receiving the transmission from the PC5 computer, through a process in its assignment of data communication control module 71 the CPU 70 of the moderator's PCm computer will receive the image data from the PCT5 screen display image sent by the PC5 computer, and will save them in RAM 85 in association with the computer name (Step S307). Through a process in its assignment of the image synthesis module 72, the CPU 70 will generate from the image data of the PCT1, 5, 3 and 4 screen display images that were saved in RAM 85 the synthesized image data that represent a synthesized image of the PCT screen display images 1, 5, 3 and 4, and will record this data in RAM 85 (Step S308).

Then, when Student A is finished explaining the display image on the PCT1 screen, Instructor M will control the input system 101 to instruct the alternation of the image being projected on the SC1 screen, from the full screen display of the display image. PCT screen for split screen display (Operation 0363). Specifically, from the W500 Projector Operation window displayed on video 115 of the moderator's PCm computer, Instructor M will click on the B615 Full Screen Display button on the upper left screen subwindow W610.

Upon receipt of this instruction, the CPU 70 of the moderator's PCm computer, through a process in its assignment of alternating image reception module 74, will receive the instruction and then, through a process in its assignment of the modulation module. data communication control 71 will send to the PR1 projector the synthesized image data of the PCT1 screen display images, 5, 3, 4 that were recorded in RAM 85 (Step S310).

However, in the PR1 projector, through a process in its assignment of data reception module 121, CPU 120 will receive the synthesized image data from the PCT1 screen display images, 5, 3, 4, and the same way as in the Step S340, previously mentioned, and Step S341, will project the image on the SC1 screen (Step S342). When doing so, as shown in the left column in Figure 10, a screen divided into four screens showing the screen display images, respective PC1, 5, 3 and 4 will be displayed in the split screen areas SC11-SC14. This completes the screen switching process for the modality.

In this modality, in response to a request for data transmission from the moderator's PCm computer, PC1-PC5 computers will send the image data recorded on VRAM 61 to the moderator's PCm at the moment the transmission request has been received; however, no limitation to such an arrangement is intended. For example, PC1-PC5 computers could instead, at periodic intervals, transmit the image data recorded on VRAM 61 to the moderator's PCm computer. Alternatively, the data could be transmitted to the moderator's PCm whenever the data in VRAM 61 was updated. With such an arrangement, upon updating the image being displayed on the SC1 screen to the most recent image by the method shown in the modality whenever the moderator's PCm computer receives the image data, it will be possible that the images on the PCT1-PCT5 screen reflecting changes to the PCT1-PCT5 screen display images are shown on the SC1 screen, even where the PCT1-PCT5 screen display image on any of the PC1-PC5 computers has changed, or where the PCT1-PCT5 screen display image is a moving image. Where such an arrangement is employed, it will be possible to reduce the traffic load on the l_AN local area network by having PC1-PC5 computers transmitting only the updated portion of the data.

Although this modality has shown an example in which the PCT1-PCT5 screen display images are projected on the SC1 screen, it would also be possible to project the PCTm screen display image, from the moderator's PCm computer, through selection by Instructor M from the W520 participant indicator sub-window of the W500 Projector Operation window. In this case, instructor M will minimize the W500 Projector Operation window when the desired image data is shown in video 115.

In this modality, the PCT1-PCT5 screen display images of the PC1-PC5 computers constitute the images for projection on the SC1 screen, but no limitation is hereby intended, and it would be acceptable to display any other image processed by the PC1-PC5 computers. For example, if PC1-PC5 computers are equipped with webcams, the images captured in this way could be projected. Alternatively, it would be possible to project any specified image from the image data stored on the computers, more properly than the current display in video 65 of each of the PC1-PC5 computers.

In this modality, a projector was described using the image display device included in the conference system 10, but several other types of display devices, such as plasma video, liquid crystal video, organic EL video, or similar, also could be used. In addition, also by example, PC1-PC5 computers have been described as the terminals included in the conference system 10, the terminals could be composed of several other types of communication terminals such as mobile phones, PDAs (Personal Digital Assistants), and so on.

In this modality, the moderator's PCm computer functioned as the server to receive the image data from the PC1-PC5 computers, generate the synthesized images, transmit them to the PR1 projector and so on; however, the moderator's PCm computer, operated by Instructor M, and the server, could be provided as separate devices. This can reduce the load on the moderator's PC, and improve the usability of the moderator's PC. In such a case, the hourly profiles saved on the hard drives 30 of the PC1-PC5 computers, as well as the hourly profile 83 and the class 84 composition profile, stored on the hard drive 80 of the moderator's PC computer , can be managed instead by the server. This will allow Instructor M and AE student schedules, the composition of each class, and so on, to be managed in an integrated manner, making management easier.

Using image data, from images processed by PC1PC5 computers, and received by the moderator's PCm computer, from PC1PC5 computers, as well as image data from images processed by the moderator's PCm computer, the conference system 10 of the above configuration generates data synthesized image and transmits the data to the PR1 projector. Consequently, the PR1 projector can display a synthesized image simply by displaying the synthesized image data it has received. That is, using an existing PR1 projector that does not have any special split screen display functionality, it is possible that the images processed by the PC1-PC5 computers and the moderator's PCm computer, which are connected to the local area network LAN, are displayed as a single split-screen display. Additionally, through simple operation using the moderator's PCm computer, the moderator's PCm operator will be able to display desired images also from his own computer, without the need to operate a separate terminal.

The conference system 10 can switch the image data transmitted to the PR1 projector via the data communication control module 71 of the moderator's PCm between synthesized image data, and image data processed by any of the PC1- computers PC5 or the moderator's PCm computer. Consequently, users will be able to conference while viewing a synthesized image, an image processed by any of the PC1PC5 computers, or an image processed by the moderator's PCm computer, as permitted by the conditions.

During the time that any of the PCT1PCT5 or PCTm screen display images are being projected in full screen display on the SC1 screen, the conference system 10 of the above configuration can generate desired synthesized images through the operation of the moderator's PCm computer, and when the image generation is complete, you can switch the SC1 screen display from the full screen display to the split screen display to display the image data synthesized in this way; consequently, during switching between screens, it will be possible to avoid unnecessary waiting time for the synthesized image data to be generated and displayed, so that the discussion can continue without interruption. The conference, therefore, can proceed smoothly.

C. Alternative Mode:

An alternative embodiment of the present invention will now be described. A detail of difference from the preceding modality is that the moderator's PCm computer is provided with a unit to receive an instruction to transmit image data to the PR1 projector, and a unit to alert the user of the moderator's PCm when generating synthesized image is complete. This difference will be discussed in detail below.

Figure 14 and Figure 15 are illustrations showing an exemplary flow of an alternating split-screen display process in the alternative mode. In Figure 14 and Figure 15, the process steps comparable to those in the modality were assigned the same symbols as in the modality, and are not discussed in any detail. This process will be initiated when Instructor M instructs the moderator's PCm computer to generate synthesized image data that represents the PCT1PCT4 screen display images of the PC1-PC4 computers as a four-screen split image (Operation 0380). Although operation 0360 in the modality was an operation to instruct the generation and transmission of synthesized image data, this operation differs from operation 0360 in that it instructs only the generation of the synthesized image data.

Operation above 0380 is performed using a method comparable to operation 0360 in the modality. However, the GUI employed in this alternative modality has a few differences from those in the previous modality. A specific example of the W500 Projector Operation window, used in the alternative mode, is illustrated in Figure 16. One point of difference from the modality is that the W600 Projector Operation sub-window included in the W500 Projector Operator window has a Send B650 button and a completed D607 image synthesis indicator field. They will be discussed in detail later. When an instruction to generate image synthesis data is received, CPU 700 will receive image data from PC1-PC4 computers, and will generate image synthesis data from PCT1-PCT4 screen display images (steps S300-S302, S320 , 321). When the generation of the synthesized image data is completed, through a process in its assignment of the completed synthesis alert module 78 the CPU 70 will alert the user of the moderator's PCm computer, that is, the M Instructor, when the data generation synthesized image is complete (Step S303). Specifically, the “Completed Image Synthesis” message will appear in the completed image synthesis indicator field D607, for example.

Having verified through the aforementioned Step S303 that the generation of the synthesized image data is complete, Instructor M will now use the input system 101 to click on the Send B605 button to instruct that the synthesized image data thus generated be sent to the projector PR1 (0381).

Upon receipt of this Send instruction, through a process in its assignment of transmission instruction reception module 77, the CPU 70 of the moderator's PCm computer will transmit the synthesized image data generated to the PR1 projector for displaying the display images in PCT1-PCT4 screen in split screen display in four screens (Steps S304, S340).

In other words, a significant difference from these processes in relation to those of the modality is that no image data will be transmitted to the PR1 projector until CPU 70 in its transmission instruction reception module assignment 77 receives the Send instruction.

Next, Instructor M will instruct the moderator's PCm computer to create, from the synthesized image data of the PCT1-PCT4 screen display images, the synthesized image data in which the PCT2 screen display image is replaced by the image PCT5 screen display (Operation 0382). Upon receipt of this instruction, the PC 70 of the moderator's PCm computer will receive the image data from the PCT5 screen display image from the PC5 computer, and will generate synthesized image data representing a synthesized image of the PCT1 screen display images , 5, 3 and 4 (Step S306-S308, S322-S323).

When the generation of the synthesized image data is complete, through a process in its assignment of the completed synthesis alert module 78, CPU 70 will alert the user of the moderator's PCm computer, that is, Instructor M, of the fact that the generation of the synthesized image data is complete (Step S309). As in the previously mentioned step S303, the D607 completed image synthesis indicator field can be used as the specific alert method.

Having verified through the previously mentioned step S309 that the generation of the synthesized image data is complete, Instructor M will now use the input system 101 to click on the Send B605 button and instruct that the generated synthesized image data be sent to the PR1 projector (0383).

Upon receipt of this Send instruction, through a process in its assignment of transmission instruction reception module 77, the CPU 70 of the moderator's PCm computer will transmit the generated synthesized image data to the PR1 projector for displaying the images screen display PCT1, 5, 3 and 4 in screen display di24 divided into four screens (Steps S310, S342).

In this modality, the D607 completed image synthesis indicator field of the W600 Projector Operation sub-window is used as the unit through which CPU 70 notifies Instructor M when the synthesized image data generation is complete; however, no limitation to that specific mode is intended. For example, CPU 70 could instead consult ROM 88 and display the conditions for generating the synthesized image data in the W700 preview sub-window. In such a way, Instructor M can be notified when the generation of the synthesized image data is complete.

In the conference system 10 having the above configuration, the moderator's PCm computer will transmit the display data only upon receipt of an instruction to transmit the image data to the PR1 projector. Consequently, the synthesized image data representing a new split screen display (for example, PCT screen display images 1,5,3, 4) can be generated through a separate process from the previous display, while the PR1 projector is still displaying the given split-screen display (for example, on the PCT1-PCT4 screen display images). Then, after the generation of the new display is complete, when an instruction to send the synthesized image data to the PR1 projector is received, when switching from the predetermined, split-screen display to the new split-screen display, it will be possible avoid unnecessary waiting time before synthesized image data is generated and displayed. Such advantages will be particularly significant in cases where the new split screen display contains a large number of split screens; where some time is required to generate the synthesized image data due to the large size of the image data for display; or where factors such as traffic conditions on the local area network LAN result in low communication speeds between the moderator's PCm computer and PC1-PC5 computers.

In the conference system 10 having the above configuration, as the moderator's PCm computer alerts the moderator's PCm user when the synthesized image data generation is complete, the moderator's PCm user can switch the display image after being informed that the generation of the synthesized image data is complete. Consequently, when switching between display images, it will be possible to do this switching while estimating exactly the timing in such a way as to avoid the waiting time required to generate and display the image data.

Although the present invention has been described here in certain preferred embodiments, it is to be understood that the present invention is by no means limited and can be reduced to practice in other ways without departing from the spirit and scope of the invention. For example, in addition to the conference system presented above, the invention can be carried out in other modes such as a server, an image display method, a computer program, or a recording medium.

Various other modes of operation of the invention will be described below. One of these modes is a conference system as shown above, in which the terminals are composed of a plurality of terminals; the receiving unit receives image data from the terminal from at least two of the plurality of terminals; and the other image includes an image represented by at least one image data set between the terminal image data received from at least two terminals.

With the conference system having this configuration, as the terminals are composed of multiple terminals, and the receiving unit receives image data from the respective terminal from at least two terminals between the plurality of terminals, the images processed by the plurality of terminals can be displayed in a single split-screen view.

Alternatively, the other image may include an image processed by the server. In a conference system having this configuration, an image processed by a terminal and an image processed by the server can be displayed in a single split-screen display. Consequently, through simple operation using the server, the server user will be able to display a desired image also from his own computer, without the need to operate a separate terminal.

In addition, and another possible configuration for the conference system, the second transmission unit may include a switching unit that switches the transmitted data for display from the synthesized image data to the terminal image data received by the receiving unit , or for server image data representing an image processed by the server.

With a conference system having this configuration, as the second transmission unit includes a switching unit for switching the transmitted display data from the synthesized image data to the terminal image data or to the server image data, users can conduct a conference while viewing a synthesized image, a terminal image, or a server image as permitted by the conditions.

The server can also include a first receiving unit that receives an instruction to switch the data for display; and a second transmitting unit can switch data for display on the basis of an instruction received by the first receiving unit.

With a conference system having this configuration, the server receives an instruction to switch the data for display, and switches the data for display depending on that instruction. Consequently, the user can switch between displayed images, as allowed by the conditions of the conference, and the conference can proceed smoothly and in a highly flexible way.

In such a conference system, the image synthesis unit can generate new image synthesis data when the second transmission unit has switched the data for display from the image synthesized data to the terminal image data or to the image data. server image.

With a conference system having this configuration, new image synthesis data will be generated when the data for display has been switched from the image synthesized data to terminal image data or server image data. Consequently, during the time that the image display device is displaying the terminal image or the server image, new synthesized image data can be generated; and when the generation of them is finished, then switching the data for display to the new synthesized image and displaying the new synthesized image will be possible to avoid unnecessary waiting time for generation and display of the synthesized image data when the displayed image is switched.

Alternatively, the server may further include a second receiving unit that receives an instruction to transmit the data for display to the image display device; and the second transmitting unit can transmit the data for display on the basis of an instruction received by the second receiving unit.

With the conference system having this configuration, the server receives an instruction to transmit the data for display to an image display device, and transmits the data for display based on that instruction. Consequently, during the time that certain synthesized image data is being transmitted to the image display device, with data for display; and the synthesized image is being displayed on the image display device; new synthesized image data can be generated; and when their generation is completed, by issuing an instruction to transmit the new synthesized image data to the image display device as data for display, it will be possible to avoid unnecessary waiting time for the generation and display of the image data. synthesized image when the display image is switched.

In addition, the server may also include a unit that alerts the server user when the generation of the image data synthesized by the synthesis unit is complete.

With a conference system having this configuration, the server user will be alerted that the generation of the image data synthesized by the synthesis unit is complete, so that the server user will be able to switch the displayed image upon confirmation that the generation of the synthesized image data is complete. Consequently, when switching between display images, it will be possible to make a switch while estimating the timing in such a way as to avoid unnecessary waiting time to generate and display the image data.

In addition, in this conference system, the server may also include a third receiving unit that receives an instruction to specify the images to compose a synthesized image; and the image synthesis unit can generate the image synthesized data based on an instruction received by the third receiving unit.

With a conference system having this configuration, the server receives an instruction to specify images for inclusion in the synthesized image, and based on the instruction generates the synthesized image data. Consequently, the user can switch between displayed images as allowed by the conditions of the conference, and the conference can proceed smoothly and in a highly flexible way.

The image processed by the terminal can be an image that is displayed on a video screen provided for the terminal. With a conference system having this configuration, as an image displayed on the video screen provided for the terminal can be displayed, the user of a terminal can explain the content displayed on the image display device while checking the terminal display screen at question.

The present invention should in no way be considered to be limited to the modalities and modes presented herein, and the scope of the invention should be determined by the appended claims and the essential technological characteristics of the invention.