A handful of U.S. casual dining chains are planning to move into the Japanese market, counting on not just the domestic base of customers but also a rising number of foreign visitors in the run-up to the 2020 Tokyo Olympics.

Menus offered by these "fine casual" restaurants are pricier than conventional fast food chains. But teaming up with local partners, the prospective entrants reckon they can capture a slice of the Japanese market at a time when the economy appears to be emerging from the shackles of deflation and consumers are developing a taste for more authentic culinary experiences.

The food service market is one of the solid growth areas of the economy, weathering the impact of the consumption tax hike in April last year. Per-diner spending in Japan increased 2.9 percent in 2014 from a year earlier, excluding the tax increase, according to the Japan Food Service Association.