Because of neglect and vandalism, by 1936 the Seahorse Inn had been reduced a shell. Mr R.B. Whiter, a builder from Lakes Entrance, purchased the property in 1936 and then, along with his two sons, began the long task of restoring the inn.