According to The Old Farmer’s Almanac, May Day baskets were popular back in the 19th and 20th centuries.

References to May Basket Day can be found in literature from past ages. People would fill paper baskets or cones with treats, baked goods, and flowers and knock on the recipient’s door and yell “May basket!” and run away. If they got caught, the gifter owed the giftee a kiss.
Who doesn’t love a little something from a secret admirer? It might be something fun to try this year!