Hugues Capet used the title, Duke of France, as well as Count of Paris.
So both of these titles, used nowadays by the head of the Bourbon house, are originally Capetian.
Please note - the Bourbons descend in a direct male line from Hugh Capet. The present Comte de Paris descends directly from Henry IV, first Bourbon King of France, and he himself descends directly from Robert Capet, a younger son of King St Louis, who married the heiress of the Bourbon title and founded the junior Capetian branch of Bourbon.
---------------------
William the Conqueror was Duke of Normandy and the title was held by his descendants, as a fief of the French Crown.
From the time of Edward III onwards, the English king also styled himself "King of France".
So Queen Elizabeth is not only Duchess of Normandy but also Queen of France.
Both her "Kingdom of France" and "Duchy of Normandy" are limited to the Channel Islands, since the rest obviously has been lost long ago

Kinda like Taiwan, I believe, who style themselves "China" although they lost mainland China long time ago.
However, I do believe that there were a number of French princes who held the title "Duc de Normandie" throughout the ages, although I don't believe any of them survived to adulthood or had any issue.