If you just delete the /pmagic dir, a lot (the real ones) of Parted Magic files are already gone.
Some scripts that update definition files for antivirus programs. Those antivirus programs can be run in Parted Magic. Those files are very small and you won't see them in the boot menu. If you don't need them even if you have Parted Magic. It is an optional script that you can use, but don't necessary need, just like the other tools in the /ubcd/toools folder.
The ./ubcd/tools/linux/syslinux2grub4dos/syslinux2grub4dos.sed file can convert the syslinux menu to an uptodate grub4dos menu. If you remove all Parted Magic related stuff in the syslinux menus, the script still works.
You only have to remove the Parted Magic entries from the following files to get rid of all Parted Magic stuff:
If you want the grub4dos menu cleared too, run ./ubcd/tools/linux/syslinux2grub4dos/syslinux2grub4dos.sh after you have corrected the previous files to your liking (will update the grub4dos config files).
Removing utilities of Parted Magic from the HDD ==> Recovery, Partition Management and Cloning submenu is possible for the next release, but I am not sure if it is an advantage to have them removed.
If you don't know Parted Magic and you are looking for a cloning tool (in the menus), you may miss a great program included in Parted Magic.
From which bootmanager did you try to boot Memtest 86+?
Download Ultimate Boot CD v5.0
Use Parted Magic
for handling all partitioning task: http://partedmagic.com/