Definitions of fly-by-night:

• noun:   a debtor who flees to avoid paying
• adjective:   of an impermanent nature

  Example: "The symphony is no fly-by-night venture"

• adjective:   of businesses and businessmen

  Example: "A fly-by-night operation"