On your own posts, you can delete both your and other people's comments. On other people's posts, you can only delete comments that you've written.

To delete a comment:

You can also delete multiple comments you’ve made on Instagram posts.