3D telepresence, which is a real-time dynamic hologram depicting a scene occurring in a different location, has brought public attention as very attractive technique since the introduction of its concept in original Star Wars film in 1977. However, conventional holographic telepresence techniques require bulky recording system and has limited refresh rate. Here we introduce high-performance holographic telepresence system which provides large viewing angle, field of view with real-time refresh rate. To this end, we non-periodic pinhole mask and speckle correlated scattering matrix (SSM) is used. The non-periodicity of pinhole mask eliminates unwanted aliased signals and the limited size of pinhole enhances the space-bandwidth product of the optical system. In order to maximize the refresh rate of the system, the very same mask is attached to the camera, enabling us to skip time-consuming computer-generated holography(CGH) calculation procedure. The optical field is reconstructed by applying the principle of SSM to the acquired intensity image.