As Japan receives more and more visitors from abroad, the number of places offering free Wi-Fi available will only increase. Japan Railways is joining in the trend too and, since May 1, will start to offer free Wi-Fi on board its bullet train services. For the moment, only the E5 Type 1 trains on Tohoku Shinkansen line (Tokyo–Aomori) are enabled, but it will be extended to include Type 3 trains in the near future.
All JR Yamanote Line stations already allow visitors to stay connected through the network “JR-EAST FREE Wi-Fi SSID”. It is easy to use and English-friendly for foreign tourist.
Source
JR Press Release (Japanese)