Splitting Strings with Regex in Managed C++ Applications


Desktop-as-a-Service Designed for Any Cloud ? Nutanix Frame

People who are familiar with regular expressions tend to think of them only in conjunction with searching a string for specific literals or patterns (such as e-mail address formats). However, one very nice feature that they often overlook is the ability to split strings into substrings based on defined delimiters or tokens.

Before I started using regular expressions, I—like many programmers who started in C—used the strtok function to delimit strings. The following is an example of using the strtok function to split a comma-delimited string into its various tokens:

void strtoktest()
  char input[] = _T("Tom,Archer,Programmer/Trainer,CodeGuru");
  char delimiters[] = _T(",");

  for (char* token = strtok(input, delimiters);
       token != NULL;
       token = strtok(NULL, delimiters))

The output is as follows:


As you can see, strtok is pretty basic and easy to use. In fact, the strtok function is at the heart of a popular comma-delimited file class that I use much more than one would assume in this day and age. However, let's face facts. The function really is a hold-over from the C day; it's not object-oriented and certainly not very intuitive (I've used it for years and have to look up the syntax every single time I need it). A more modern approach is using the .NET Regex class and its Split method. Using the same input as the previous example, here's how you would delimit the same string input using the Regex class:

using namespace System::Text::RegularExpressions;

void regextest()
  String* input = _T("Tom,Archer,Programmer/Trainer,CodeGuru");
  Regex* regex = new Regex(S",");
  String* tokens[] = regex->Split(input);

  for (int i = 0; i < tokens->Length; i++)

As you can see, it only takes two lines of code: instantiating a Regex object (passing the delimiter list) and calling the Split method. One more advantage of using Regex::Split instead of strtok is that the result of the single call to Split is an array of all the strings (tokens). Obviously, it's not that much work to write the code to stuff the strings into an array yourself, but this is just one less step if your delimiting function is being called by another function that needs all of the strings returned in an array.

Looking Ahead

For various reasons—probably inertia more than any other—I never really got into using regular expressions until I started programming with .NET back in 2000. However, regular expressions really do make a lot of basic chores so much easier. I sometimes kick myself for not having used them much sooner. In future articles, I'll cover more aspects of the Regex class, such as using the Match and MatchCollection classes, how to properly use captures and groups, and searching for complex patterns such as e-mail addresses.

About the Author

Tom Archer - MSFT

I am a Program Manager and Content Strategist for the Microsoft MSDN Online team managing the Windows Vista and Visual C++ developer centers. Before being employed at Microsoft, I was awarded MVP status for the Visual C++ product. A 20+ year veteran of programming with various languages - C++, C, Assembler, RPG III/400, PL/I, etc. - I've also written many technical books (Inside C#, Extending MFC Applications with the .NET Framework, Visual C++.NET Bible, etc.) and 100+ online articles.


  • Please Help

    Posted by Mahee on 10/23/2012 05:21am

    C/C++ program to return a list which will contain each word and number of occurences in the sentence "cap is map then map did buzz cap many map".

  • Dividng a string of characters inot parts

    Posted by lexito on 05/23/2008 06:06pm

    how can you display ex. 234578E, in parts of as
      when it is pases to a function

  • good

    Posted by murongtianfeng on 12/07/2006 06:08am

    it is usefull

  • Splitting strings with multiple delimiters

    Posted by Black Sabbath on 11/04/2005 12:25am

    I have string for e.g. XTOP/X1:Z, I have to split that into XTOP X1 Z Can you suggest a way other that paring each character and comparing it with each delimiter type(/,: etc.) -Black Sabbath

  • How about String::Split ?

    Posted by darwen on 02/24/2005 02:34am

    What about String::Split ? It does the same as your example. In fact the RegEx class can be used to do far more complicated pattern-matched splits as you have said here.

    • If you have any suggestions...

      Posted by Tom Archer on 02/24/2005 03:10am

      I've used regex quite a bit over the past few years and will definitely want to cover things like groups and captures as that really seems to be an area that few people understand. If you have any specific areas that you think should be covered, let me know. I am a bit wary of getting into the specifics of the patterns themselves as technically that's nothing to do with .NET or Managed C++. What's you opinion on that?

    • I look forward to the next one...

      Posted by darwen on 02/24/2005 02:58am


    • Absolutely

      Posted by Tom Archer on 02/24/2005 02:49am

      That's why this is the first in a series. Not everyone is experienced with regex so I wanted to start with the basics and gradually work towards more complex examples.

  • You must have javascript enabled in order to post comments.

Leave a Comment
  • Your email address will not be published. All fields are required.

Most Popular Programming Stories

More for Developers

RSS Feeds

Thanks for your registration, follow us on our social networks to keep up-to-date