Digital displays have been extensively used at various indoor and outdoor venues to provide updated information such as advertisements to the audiences. With the pervasiveness of the smartphones nowadays, it is possible to utilize smartphones to design new interactive display systems for advertising purposes. Many such examples have been surveyed to reveal the trend and limitations of existing interactive display systems. With digital displays and interactive display systems becoming trendy, it is expected that there will be multiple displays ready for interaction at one venue with complicated setups. Supporting the interaction between multiples displays and smartphones requires a cyber-physical approach, which should be intuitive and accurate for the users, and none of the previously...[ Read more ]

Digital displays have been extensively used at various indoor and outdoor venues to provide updated information such as advertisements to the audiences. With the pervasiveness of the smartphones nowadays, it is possible to utilize smartphones to design new interactive display systems for advertising purposes. Many such examples have been surveyed to reveal the trend and limitations of existing interactive display systems. With digital displays and interactive display systems becoming trendy, it is expected that there will be multiple displays ready for interaction at one venue with complicated setups. Supporting the interaction between multiples displays and smartphones requires a cyber-physical approach, which should be intuitive and accurate for the users, and none of the previously mentioned systems have considered this issue. A new framework of cyber-physical interaction between multiple displays and smartphones is proposed in this paper. This framework solves the problem in a divide-and-conquer manner with region approximation and venue division. Region approximation targets venues with simple and symmetrical layouts. By using azimuth angle measured by smartphone’s orientation sensor, it optimally assigns a range of azimuth angle to each display, such that a user can interact with an interested display by pointing at it with minimal overall interaction error. Venue division targets venues with complex layouts. By using a heuristic hierarchical clustering algorithm, it divides a complex venue layout into several regions that can be managed by the previous region approximation. In this thesis, the new framework of cyber-physical interaction between multiple displays and smartphones is described in detail with simulation results revealing its characteristics. The framework is implemented and experimented to prove its feasibility and practicality. Compared with existing interactive display systems, the new framework has the advantages of supporting intuitive and accurate interaction between multiple displays and smartphones, and requiring only proximity information which eliminates the use of inaccurate and unreliable location information and excess infrastructures.