Prime Minister Shinzo Abe on Wednesday withdrew a recent remark on Japan's discretionary work system, while opposition lawmakers questioned the validity of the labor ministry survey on which Abe's remarks were based.