tokenizer.cpp File Reference

#include <cctype>
#include <cmath>
#include <iomanip>
#include <celutil/utf8.h>
#include "tokenizer.h"

Include dependency graph for tokenizer.cpp:

Go to the source code of this file.

Functions
static bool	issep (char c)

---

Function Documentation

static bool issep (  char  c  )  [static]

Definition at line 17 of file tokenizer.cpp. Referenced by celx::Scanner::nextToken(), and Tokenizer::nextToken(). { return !isdigit(c) && !isalpha(c) && c != '.'; }

---