{
    "mode": "ri",
    "parameter": "RDoc::TokenStream",
    "section": "",
    "url": "https://www.chedong.com/phpMan.php/ri/RDoc%3A%3ATokenStream/json",
    "generated": "2026-06-02T15:56:36Z",
    "sections": {
        "RDoc::TokenStream": {
            "content": "(from gem rdoc-7.2.0)\n------------------------------------------------------------------------\nA TokenStream is a list of tokens, gathered during the parse of some\nentity (say a method). Entities populate these streams by being\nregistered with the lexer. Any class can collect tokens by including\nTokenStream. From the outside, you use such an object by calling the\nstartcollectingtokens method, followed by calls to addtoken and\npoptoken.\n------------------------------------------------------------------------",
            "subsections": []
        },
        "Class methods:": {
            "content": "tohtml\n",
            "subsections": []
        },
        "Instance methods:": {
            "content": "addtoken\naddtokens\ncollecttokens\npoptoken\nsourcelanguage\nstartcollectingtokens\ntokenstream\ntokenstos\n",
            "subsections": []
        }
    },
    "flags": [],
    "examples": [],
    "see_also": []
}