In this study, we primarily focus on prototyping CNN-object detection assisted projection mapping that can encode information on the environmental object and HFR vision-based decoding while maintaining the confidentiality of data to be communicated. Projection mapping has been used in the entertainment industries and in scientific research as a surface-oriented video projection system for augmenting realistic videos onto the desired surfaces [
2‐
4]. They are widely used for visual augmentation in buildings, rooms, and parks [
5‐
7]. Projection-mapping-based systems are mainly classified as static and dynamic projection mapping. Static projection mapping is usually preferred in industries and scientific researches for shape analysis using structured light projection mapping [
8,
9]. It involves a projection of light patterns by manually aligning the objects and projectors [
10‐
13]. In dynamic projection mapping (DPM), a system tracks the desired surfaces’ positions and shapes using a marker [
14‐
16] followed by model [
17‐
19] tracking methods to project videos onto the moving surfaces. Asayama et al. [
20] proposed an approach on visual markers for the projection of dynamic spatial augmented reality (AR) on fabricated objects. DPM requires heavy computation to acquire dynamic, realistic effects in real-time [
21,
22]. Narita et al. [
23] have explained using a dot cluster marker for DPM onto a deformable nonrigid surface. The use of an RGB depth sensor-assisted projector with a DPM to render surfaces of complex geometrical shapes was reported [
24] for developing an interactive system of surface reconstruction. Several approaches using nonintrusive and imperceptible patterns have been presented using projection mapping. Lee et al. [
25] have proposed a location tracking method based on a hybrid infrared and visible light projection system. Their system has the unique capabilities of providing location discovery and tracking simultaneously. Visible light-emitting projection devices such as high-speed digital light projection (DLP) systems are enabled with a high-frequency digital micromirror device (DMD) to project binary image patterns at thousands of fps [
26‐
29]. DMD projectors have been used in structured-light-based three-dimensional (3D) sensing, interactive projection mapping, and other geometric and photometric applications [
30‐
33]. Daniel et al. [
34] presented a simultaneous acquisition and display method that can embed imperceptible patterns in projected images. High-speed switching between the projected pattern and its complementary pattern with DLP is used in their research, indistinguishable by HVS. However, the resultant projection leads to lower brightness, and hardware modification is required in such a system [
35]. High-speed projection systems that can emit light at a higher frequency than the HVS have been used in numerous AR applications. The projection patterns and their complementarity at 120 Hz are sufficient to generate uniform brightness projections to the HVS [
36‐
38]. Color-wheel filter-based 3D projectors with the DLP principle can emit 120-Hz color-plane patterns [
39,
40]. Projection mapping based VLC has been used to establish a wireless link between projection and sensing systems to transmit anticipated information [
41‐
43]. Kodama et al. [
44] have designed a VLC position detection system embedded in single-colored light using a DMD projector. They used photodiodes as sensors to decode the projected area location for IoT applications. However, the photodiode-based sensor cannot obtain complete projection information at an instant. Conventional vision systems that operate at tens of fps cannot capture temporal changes in high-speed projection. They lead to a severe loss of temporal information. Hence, an HFR vision system to sense temporal alterations in high-speed projection data is required. With millisecond-level accuracy, HFR vision systems operated at hundreds or thousands of fps have been used for various industrial applications [
45‐
48]. A saccade mirror and HFR cameras have been used to add visual information in real-time for the projection-based mixed reality of dynamic objects [
49]. An HFR camera-projector depth vision system has been used for simultaneous projection mapping of RGB light patterns augmented on 3D objects by computing the depth using a camera projector system [
50]. Temporal dithering of high-speed illumination was reported for fast active vision [
51]. HFR vision systems have also been used as sensing devices in many applications such as optical flow [
52], color histogram-based cam-shift tracking [
53,
54], face tracking [
55], image mosaicking, and stabilization [
56,
57]. Hence, HFR vision systems can be used as an environment sensing device in CPS.