Accordance with the WTO "TRIPS Agreement", each country can decide freely whether to grant trademark protection for non-visual signs such as sound or smell. Nowadays, the protection of the sound trademark has been recognized by some countries’ laws. As a new form of trademark, the legislative practice of sound mark in China is still in its infancy. Based on comparative study of different countries laws and legislative practice on sound trademark, this paper discusses the necessity and significance to protect the intellectual property rights and to implement sound trademarks. Finally, some countermeasures and suggestions are put forward.