One of Japan's last surviving silk mills is rapidly falling into disrepair and could collapse despite a local campaign to save it.