Posts

Using Optical Illusions and AI to Study Brain Function [Video content from NHK world]

Image
"Using optical illusions and AI to study brain function" [Video content from NHK WORLD] is now available! URL:  https://www3.nhk.or.jp/nhkworld/en/tv/scienceview/20211116/2015268/ Higher layers of neurons visualize more complex shapes (Illustration from NHK world)

Okazaki Genkikan Illusion, Prize-winning work of the 13th Illusion Contest in Japan

Image
  This illusion was found in a facility called Okazaki Genki-kan. This is the illusion that the line seen through the slit do not appear to be line. This image is similar to the Poggendorff illusion, but the motion of the camera makes it look very striking. Eiji Watanabe: National Institute for Basic Biology Lana Sinapayen: SONY CSL Citation Watanabe, Eiji; Sinapayen, Lana (2021): Okazaki Genkikan Illusion. figshare. Media. https://doi.org/10.6084/m9.figshare.16910725 PS: Eiji Watanabe (National Institute for Basic Biology) and Lana Sinapayen (Sony CSL / ELSI) got 2nd place at the 13th Visual Illusion and Auditory Illusion Contest, for the Okazaki Genkikan Illusion.

[code] PredNet in pytorch and related data

Image
We have released new prednet in pytorch. PredNet in pytorch and related data are here: PredNet in pytorch https://github.com/eijwat/prednet_in_pytorch (We recommend lr_rate option set to 0.9.) Sample Weight Models (for Rotating Snake Illusions) https://doi.org/10.6084/m9.figshare.16572065 Test and training data https://ewatanabe.blogspot.com/2019/06/predictive-coding-deep-neural-networks.html

[arXiv] "Artificial Perception Meets Psychophysics, Revealing a Fundamental Law of Illusory Motion"

Image
 "Artificial Perception Meets Psychophysics, Revealing a Fundamental Law of Illusory Motion" Taisuke Kobayashi, Eiji Watanabe https://arxiv.org/abs/2106.09979

[arXiv] "Motion Illusion-like Patterns Extracted from Photo and Art Images Using Predictive Deep Neural Networks"

Image
 "Motion Illusion-like Patterns Extracted from Photo and Art Images Using Predictive Deep Neural Networks"  Taisuke Kobayashi, Akiyoshi Kitaoka, Manabu Kosaka, Kenta Tanaka, Eiji Watanabe https://arxiv.org/abs/2106.12254

[bioRxiv] "Laterally biased diffusion of males of the water flea Daphnia magna"

Image
 "Laterally biased diffusion of males of the water flea Daphnia magna" Kenji Toyota, Masaki Yasugi, Norihisa Tatarazako, Taisen Iguchi, Eiji Watanabe https://doi.org/10.1101/2021.01.21.427564

Monstre Matin Illusion: 10th Award of the 12th Illusion Contest in Japan

Image
Eiji Watanabe (National Institute for Basic Biology) and Lana Sinapayen (Sony CSL / ELSI) got 10th place at the 12th Visual Illusion and Auditory Illusion Contest, for the Monstre Matin Illusion. The Monstre Matin Illusion is one of the color aftereffect induced by glare effect. Concentrate on the cross. Enjoy it! Further Demo & Citation: Watanabe, Eiji; Sinapayen, Lana (2020): Monstre Matin Illusion. https://doi.org/10.6084/m9.figshare.13125518

EIGen: Evolutionary Illusion Generator

Image
Collaborator Lana Sinapayen have released EIGen: Evolutionary Illusion Generator. EIGen generates static images that appear to move: motion illusions. Code: https://github.com/LanaSina/evolutionary_illusion_generator Sample Visual Illusions: https://doi.org/10.6084/m9.figshare.16800013

Motion illusions arise from light source ambiguity

Image
Lana Sinapayen and Eiji Watanabe, Motion illusions arise from light source ambiguity. The Journal of Brief Ideas, https://doi.org/10.5281/zenodo.3709097 . Published: 13 March (2020)

Monstre Benham Illusion: 2nd Award of the 11th Illusion Contest in Japan

Image
Eiji Watanabe (National Institute for Basic Biology) and Lana Sinapayen (Sony CSL / ELSI) got 2nd place at the 11th Visual Illusion and Auditory Illusion Contest, for the Monstre Benham Illusion. Lana Sinapayen and Eiji Watanabe @Kobe Univ., 2019 Benham Top is a black and white top that, when rotating, causes people to perceive illusory colors like red or blue. Illusory colors were first discovered by the German physicist Gustav Fechner, and the Benham top was built by the English journalist Charles Benham. We have implemented a version of the Benham top that instead of spinning, works like a flip book. Demo: https://www.sonycsl.co.jp/news/9164/ Citation: DOI:  https://doi.org/10.6084/m9.figshare.10046534 Eiji Watanabe and Lana Sinapayen, Monstre Benham Illusion, 2019

11th Visual Illusion and Auditory Illusion Contest in Japan

Image
Dr. Lana Sinapayen (Sony CSL / ELSI) and Pr. Eiji Watanabe (National Institute for Basic Biology) have been creating new visual illusions based on their common work. 4 of these illusions have been submitted to the 11th Visual Illusion and Auditory Illusion Contest in Japan. Please enjoy the animations. https://www.sonycsl.co.jp/news/9164/

[code] PredNet in Chainer and related data

Image
PredNet in Chainer and related data are here: https://github.com/eijwat/Predictive_Coding_DNN_S https://doi.org/10.6084/m9.figshare.5483710 (without tensorboard = faster version) or https://github.com/eijwat/Predictive_Coding_DNN_TB https://doi.org/10.6084/m9.figshare.7801154 (with tensorboard) or https://github.com/eijwat/prednet_in_chainer_py3 (without tensorboard, python 3, cuda11, cupy9.4, ubuntu20.04) or https://github.com/LanaSina/chainer_prednet (Modularized by LanaSina) Sample Weight Models (for snake illusion) https://doi.org/10.6084/m9.figshare.11931222 Sample Weight Models (for gray scale images) https://doi.org/10.6084/m9.figshare.13280120 Test data (snake illusion) https://doi.org/10.6084/m9.figshare.5483680 Training data (for snake illusion) https://doi.org/10.6084/m9.figshare.5483668 Training data (for snake illusion) <- Bug-fixed version http://www.nibb.ac.jp/neurophys/download/29v.mp4 Refer to: Watanabe E, Kitaoka A, Sakamoto K, Yasugi M and Tanaka K (2018) ...

Collaborative Research with Yamamoto lab.

Image
We used retro-reflection to perform three-dimensional imaging in water, and applied it to medaka behavior analysis. Erina Abe, Masaki Yasugi, Hideaki Takeuchi, Eiji Watanabe, Yasuhiro Kamei, and Hirotsugu Yamamoto, Development of omnidirectional aerial display with aerial imaging by retro-reflection (AIRR) for behavioral biology experiments. Optical Review https://doi.org/10.1007/s10043-019-00502-w (2019)

Ink blots Illusion

Image
Ink blots Illusion Ink blots on the blind curtain expands. Citation; DOI:  https://doi.org/10.6084/m9.figshare.6137582 Eiji Watanabe, Ink blots Illusion, 2018 You can see many variations of Ink blots Illusion at  https://doi.org/10.6084/m9.figshare.6137582 .

Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction

Image
Deep neural networks (DNNs), which have been developed with reference to the network structures and the operational algorithms of the brain, have achieved notable success in a broad range of fields, including computer vision, in which they have produced results comparable to, and in some cases superior to, human experts. In recent years, DNNs have also been expected to be useful as a tool for studies of the brain. Recently a research team led by associate professor Eiji Watanabe of the National Institute for Basic Biology successfully reproduced illusory motion by DNNs trained for prediction. The DNNs are based on predictive coding theory (Figure 1), which assumes that the internal models of the brain predict the visual world at all times and that errors between the prediction and the actual sensory input further refine the internal models. If the theory substantially reproduces the visual information processing of the brain, then the DNNs can be expected to represent the human vis...