Sure. If you need a label for each child, a simple mail merge for children will do the trick.
If you need the parent's name and all the children on one label this would do the trick. https://jlssolutions.com/QA/587/how-do-i-list-all-childrens-names-in-a-parent-mail-merge