General Gilbert du Motier, Marquis de Lafayette, hero of the American war of Independence, did not seem to play an important role during the Restauration period, and especially during the Congress of Vienna. However, one can clearly see through his personals papers, writings, and correspondence that he tried to exercise influence over the European sovereigns and politicians, especially over the Tsar Alexander I, and was surprised to find support for the abolition of slavery from the Tsar although serfdom was still in existence in Russia before the Tsar changed his mind on this matter later. This paper will try to show how the Marquis de Lafayette held a difficult position in counter-revolutionary Restauration times in France since he supported colonial rights and promoted the abolition of slavery: he met for instance with Tsar Alexander, Mme de Stael, Thomas Clarkson, and even Lords Wellington and Castelreagh among others, who all vowed their defense of the freedom of the colonies, especially in America. The clash between the ideal and reality, morals and political interests was very problematic for this liberal politician and thinker, especially because France had been the first state to abolish slavery on 16th Pluviose, year II, which had then been reestablished by Napoleon and reinforced by the Bourbons kings after 1814 much to his dismay; for him France should have remained at the forefront of the defense of Human rights. The archives of the Lafayette family helps cast a new light on this period of the Marquis‘ life and his role in the difficult political period of the Viennese Congress.