It depends on the store you want to purchase items from. The Babylist Shop accepts Klarna and Afterpay as a form of payment.
If the items you want to purchase from your registry are sold by other retailers, they will need to offer Buy Now, Pay Later as a payment option to use it.
You can see more Klarna stores here.
You can see more Afterpay stores here.