I'd prefer to have the specifics of who, when, why, and how, but I'd say that Japan would be poorer than OTL as colonies were usually set up to benefit the metropole at the expense of the colony. Thus, any infrastructure the colonizer sets up will be to facilitate further profits and easier...