The main problem is financial. Napoleon is acting as a ruler on Elba, albeit in a scaled down way, but Elba cannot support it financially. It requires the subsidies that the Bourbon kings promised to pay being paid, which they weren't OTL.
Something is still likely to happen unless somehow...