For me, this tag was related to large UIImages I had allocated. I did some investigation into how you could get more information about this and have some (perhaps) useful things to suggest.
I believe that the tags you're interested in are the ones passed via the flags argument of vm_allocate and similar, not OSMalloc_tagAlloc(). The iOS 3.1 release notes mention the <mach/vm_statistics.h> and <mach/vm_map.h> header in connection with the VM instrument.
I think that the tag is passed via the vm_allocate flags parameter as per vm_statistics.h's VM_FLAGS_ALIAS_MASK and following #defines. (They're called "aliases" here.) This means you should be able to make a dtrace script that probes for, say, vm_allocate, and extracts the tag from the flags parameter. For example:
sudo dtrace -n 'fbt:mach_kernel:vm_allocate:entry /pid==12345/ { printf("%d", (arg3 & 0xFF000000) >> 24); }'
You can use Instruments to make a dtrace instrument and run against the iOS simulator via "Build New Instrument..." in the "Instrument" menu, or you can use use a command-line dtrace script and include a /pid == 123456/ predicate for your running app.
Unfortunately, I was unsuccessful in finding the correct probe to find these allocations. When inspecting the appropriate argN variable, the flags always seems to have 0 in the tag/alia portion. I tried, for example, fbt:mach_kernel:vm_allocate as above, fbt:mach_kernel:mach_vm_allocate, fbt:mach_kernel:vm_map_enter, etc. Perhaps these allocations are going through some other avenue? I don't know much about the kernel's memory allocation system.
So, I'm not exactly sure where these tags are being passed to the kernel, but I hope this helps you track it down.