[Bug] Broken with very long prompt

[tuilakhanh]

Checklist

• 1. I have searched related issues but cannot get the expected help.
• 2. The bug has not been fixed in the latest version.
• 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

lmdeploy response is broken with very long input.

Reproduction

curl http://localhost/v1/chat/completions \
              -H "Content-Type: application/json" \
              -d "@./sample.json"

Here is input and output: https://gist.github.com/tuilakhanh/185faedb0344e42c61864b3e09d33e12

Environment

sys.platform: linux
Python: 3.10.12 (main, Jan  8 2026, 06:52:19) [GCC 11.4.0]
CUDA available: True
MUSA available: False
numpy_random_seed: 2147483648
GPU 0,1,2,3: Tesla V100-SXM2-32GB
CUDA_HOME: /usr/local/cuda
NVCC: Cuda compilation tools, release 12.4, V12.4.131
GCC: x86_64-linux-gnu-gcc (Ubuntu 11.4.0-1ubuntu1~22.04.2) 11.4.0
PyTorch: 2.8.0+cu128
PyTorch compiling details: PyTorch built with:
  - GCC 13.3
  - C++ Version: 201703
  - Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d)
  - OpenMP 201511 (a.k.a. OpenMP 4.5)
  - LAPACK is enabled (usually provided by MKL)
  - NNPACK is enabled
  - CPU capability usage: AVX512
  - CUDA Runtime 12.8
  - NVCC architecture flags: -gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_90,code=sm_90;-gencode;arch=compute_100,code=sm_100;-gencode;arch=compute_120,code=sm_120
  - CuDNN 91.0.2  (built against CUDA 12.9)
    - Built with CuDNN 90.8
  - Magma 2.6.1
  - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=a1cb3cc05d46d198467bebbb6e8fba50a325d4e7, CUDA_VERSION=12.8, CUDNN_VERSION=9.8.0, CXX_COMPILER=/opt/rh/gcc-toolset-13/root/usr/bin/c++, CXX_FLAGS= -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -DC10_NODEPRECATED -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -faligned-new -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-dangling-reference -Wno-error=dangling-reference -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.8.0, USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=1, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, USE_XCCL=OFF, USE_XPU=OFF, 

TorchVision: 0.23.0+cu128
LMDeploy: 0.11.1+
transformers: 5.0.0
fastapi: 0.128.0
pydantic: 2.12.5
triton: 3.4.0
NVIDIA Topology: 
        GPU0    GPU1    GPU2    GPU3    CPU Affinity    NUMA Affinity   GPU NUMA ID
GPU0     X      NV1     NV2     NV1     0-19,40-59      0               N/A
GPU1    NV1      X      NV1     NV2     0-19,40-59      0               N/A
GPU2    NV2     NV1      X      NV2     0-19,40-59      0               N/A
GPU3    NV1     NV2     NV2      X      0-19,40-59      0               N/A

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

Error traceback

[windreamer]

Sorry for the late reply, but it seems I did not reproduce this issue in my setup with the latest main branch.

Here I launched a TP=8 lmdeploy server with Turbomind backend (I just used a base Qwen3 instead of the instruct model):

lmdeploy serve api_server /nvme2/share/Qwen3-30B-A3B-Base/ --model-name Qwen3-30B-A3B-Instruct-2507 --tp 8 --log-level INFO --session-len 65536 --backend turbomind --cache-max-entry-count 0.8

Then I tried your sample.json file:

curl -s http://127.0.0.1:23333/v1/chat/completions \ 
-H "Content-Type: application/json" \
-d "@./sample.json" | jq .

And here is what I got:

{
  "id": "1",
  "object": "chat.completion",
  "created": 1770187519,
  "model": "Qwen3-30B-A3B-Instruct-2507",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "{\n  \"summary\": \"The Pembroke Welsh Corgi is a herding dog breed originating in Wales, known for its short stature, erect ears, and fox-like appearance. They are intelligent, alert, and eager to please, making them excellent working dogs. Pembrokes are prone to certain health issues such as hip dysplasia and degenerative myelopathy, but regular exercise and proper care can mitigate these risks. The breed has a rich history, with origins tracing back to Flemish settlers in Pembrokeshire. Pembrokes are also famous for their association with the British royal family, particularly Queen Elizabeth II, who owned many corgis throughout her reign. The breed is popular in the United States and is known for its playful and affectionate nature.\",\n  \"key_facts\": [\n    \"Origin: Wales\",\n    \"Height: 10–12 inches (25–30 cm)\",\n    \"Weight: 24–31 lbs (11–14 kg)\",\n    \"Coat: Medium length, thick, weather-resistant double coat\",\n    \"Color: Fawn, Black & Tan, Black & White, Red, Sable\",\n    \"Temperament: Intelligent, alert, eager to please\",\n    \"Health issues: Hip dysplasia, degenerative myelopathy\",\n    \"Royal association: Queen Elizabeth II owned over 30 corgis\",\n    \"Popularity: Ranked 11th in the American Kennel Club's most popular breeds in 2020\",\n    \"Historical significance: Originated with Flemish settlers in Pembrokeshire\"\n  ],\n  \"related_entities\": [\n    \"Cardigan Welsh Corgi\",\n    \"The Kennel Club\",\n    \"Fédération Cynologique Internationale\",\n    \"Stanley Coren's The Intelligence of Dogs\",\n    \"Queen Elizabeth II\",\n    \"Royal corgis\",\n    \"American Kennel Club\",\n    \"Pembroke Welsh Corgi Club of America\"\n  ]\n}",
        "gen_tokens": null,
        "reasoning_content": null,
        "tool_calls": null
      },
      "logprobs": null,
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 6591,
    "total_tokens": 7010,
    "completion_tokens": 419
  }

The following is the log of Turbomind:

INFO:     Uvicorn running on http://0.0.0.0:23333 (Press CTRL+C to quit)
2026-02-04 14:45:19,867 - lmdeploy - INFO - session_manager.py:202 - [SessionManager] session 1 not found. Creating...
2026-02-04 14:45:19,886 - lmdeploy - INFO - logger.py:45 - session=Session(id=1, step=0), adapter_name=None, input_tokens=6591, gen_config=GenerationConfig(n=1, max_new_tokens=10000, do_sample=True, top_p=1.0, top_k=40, min_p=0.0, temperature=0.3, repetition_penalty=1.0, ignore_eos=False, random_seed=None, stop_words=None, bad_words=None, stop_token_ids=None, bad_token_ids=None, min_new_tokens=None, skip_special_tokens=True, spaces_between_special_tokens=True, logprobs=None, response_format=None, logits_processors=None, output_logits=None, output_last_hidden_state=None, include_stop_str_in_output=False, with_cache=False, preserve_cache=False, migration_request=None, return_routed_experts=False), prompt='<|im_start|>user\nYou are an expert content analyst specializing in animal domain.\n\n<context>\nTopic: animal\nEntity type: dog\nTarget: corgi\nSource: Pembroke Welsh Corgi - Wikipedia (https://en.wikipedia.org/wiki/Pembroke_Welsh_Corgi)\n</context>\n\n<task>\nExtract all relevant information about "corgi" from the content below.\n\nFocus on:\n1. Factual information (specifications, dates, origins, creators)\n2. Relationships (who made it, who uses it, what it\'s related to)\n3. Context and significance within the animal domain\n4. Any unique or notable details\n\nBe comprehensive but concise. Only include information that is directly relevant to "corgi" in the context of animal.\n\nRespond in JSON format:\n{\n  "summary": "comprehensive summary here",\n  "key_facts": ["fact1", "fact2", ...],\n  "related_entities": ["entity1", "entity2", ...]\n}\n</task>\n\n<content>\nJump to content\nSearch\nContents\n (Top)\n 1 Description\n+ 1.1 Appearance\n+ 1.2 Temperament\n 2 Health\n 3 History\n 4 Folklore\n 5 Activities\n 6 Royal corgis\n 7 See also\n 8 Notes\n 9 References\nPembroke Welsh Corgi\n Български\n Català\n Čeština\n Dansk\n Deutsch\n Eesti\n Español\n فارسی\n Français\n 한국어\n Հայերեն\n Bahasa Indonesia\n Italiano\n ქართული\n Latviešu\n مصرى\n Bahasa Melayu\n Nederlands\n 日本語\n Norsk bokmål\n Norsk nynorsk\n Polski\n Português\n Scots\n Српски / srpski\n Srpskohrvatski / српскохрватски\n Suomi\n Svenska\n Tiếng Việt\n 中文\nEdit links\n Article\n Talk\n Read\n Edit\n View history\nTools\nActions\n Read\n Edit\n View history\nGeneral\n What links here\n Related changes\n Upload file\n Permanent link\n Page information\n Cite this page\n Get shortened URL\n Download QR code\nPrint/export\n Download as PDF\n Printable version\nIn other projects\n Wikimedia Commons\n Wikidata item\nAppearance\nFrom Wikipedia, the free encyclopedia\nDog breed\n| Pembroke Welsh Corgi |\n\n| Common nicknames | Corgi, Welsh Corgi, Pembroke |\n| Origin | Wales |\n| | Traits |  | Height | Males | 10–12 in (25–30 cm) | | Females | 10–12 in (25–30 cm) | | Weight | Males | 24–31 lb (11–14 kg) | | Females | 24–28 lb (11–13 kg) | | Coat | Medium length, thick, weather-resist double coat | | Color | Fawn, Black & Tan, Black & White, Red, Sable | |\n| | Kennel club standards |  | The Kennel Club | standard | | Fédération Cynologique Internationale | standard | |\n| Dog (domestic dog) |\nThe Pembroke Welsh Corgi (/ˈkɔːrɡi/; Welsh for "dwarf dog") is a cattle herding dog breed that originated in Pembrokeshire, Wales. The name Corgi is of Welsh origin, and is a compound of the words cor and ci (mutated to gi), meaning "dwarf" and "dog", respectively. It is one of two breeds known as a Welsh Corgi, the other being the Cardigan Welsh Corgi. Pembroke Welsh Corgis are descended from the Spitz family of dog.\nPembroke Welsh Corgis are famous as the preferred breed of Queen Elizabeth II, who owned more than 30 Royal corgis during her reign. Although these dogs have been favoured by British royalty for more than seventy years, among the British public they have recently fallen into decline in terms of popularity and demand. However, they remain very popular in the United States. Cities such as New York, Boston, Los Angeles, and San Francisco hold annual "Corgi Meetups" in which hundreds of dogs and their owners congregate to spend the day.\nThe Pembroke Welsh Corgi has been ranked 11th in Stanley Coren\'s The Intelligence of Dogs, which states that the breed is considered an excellent working dog. Pembroke Welsh Corgis were ranked 11th most popular breed of dog in 2020 according to the American Kennel Club.\nDescription\n[edit]\nAppearance\n[edit]\nPembroke Welsh Corgis differ from the Cardigan Welsh Corgi by being shorter in length, having smaller ears, and being slightly straighter of leg.\nThe Pembroke Welsh Corgi has erect ears that are in proportion to the equilateral triangle of the head. The breed standard indicates that the ears should be firm, medium in size, and tapered slightly to a rounded point. The head should be "fox-like" in shape and appearance. The Pembroke breed usually weighs around 22 - 27 lbs(10 to 12 kilos). They often measure between 8 to 12 inches, or 20 to 30 centimeters, and on average, live to be around 13 years old.\nDue to the Pembroke Welsh Corgi having a double coat, they shed heavily all year round, with peaks in the spring and autumn. With regular brushing, their coat is fairly easy to maintain, as well as naturally water- and dirt repellent (at the exception of "fluffies")[clarification needed]. Intact females are also known to shed during heat. Their coat has somewhat lighter markings on each side of the withers caused by changes in the thickness, length, and direction of hair growth. The Pembroke coat also varies in color, going from a reddish, or even sand color, to brown and black. Along with these differing colors, their coats will also sometimes contain a speckling of white spots.\nBreed faults exist and should not be bred on purpose; such as corgis with a very long and thinner coat coming from a recessive gene and red coats present with a bluish cast which have a diluted colour.\nWhile some outlying Pembroke Welsh Corgis are born with their tail naturally short, the majority often have their tails docked "Docking (dog)") between 2–5 days old due to historical tradition or to conform to the Breed Standard. Artificial docking was not needed for the dog to do its job as a herding dog in the United Kingdom as many claim (since Cardigan Welsh corgis were also herding dogs but never docked) but rather because a non-herding dog was considered a luxury under tax law and attracted a tax, so to demonstrate that their dogs were herding dogs, owners had to ensure the dogs had docked tails.[citation needed] The Kennel Club, the United Kennel Club, and the FCI allow intact tails in Conformation shows. The AKC Standard states tails should be docked no longer than 2 inches (5 cm). In many countries including the United Kingdom, docking has been deemed illegal.\nTemperament\n[edit]\nPembroke Welsh Corgis love to be involved in the family, and tend to follow wherever their owners go. They have a great desire to please their owners, thus making them eager to learn and train. The dogs can also be challenging to train due to their working background, stubbornness and intelligence – they were ranked as the eleventh most intelligent dog in Stanley Coren\'s The Intelligence of Dogs. Besides herding, they also function as watchdogs due to their alertness and tendency to bark, which can be aggravated if they are not stimulated adequately. Most Pembrokes will seek the attention of everyone they meet and behave well around children and other pets. It is important to socialise this breed with other animals, adults, and children when they are very young to avoid any anti-social behaviour or aggression later in life. Another thing to keep in mind is that with this need for stimulation, they also have a need for exercise, as they can easily become overweight. They love to run around and dig holes, and due to their herding and – for some – prey instinct, they love to chase anything that moves, so it is best to keep them inside fenced areas. The herding instinct will also cause some younger Pembrokes to nip at their owners\' ankles as this is what they were bred to do with cattle.\nHealth\n[edit]\nA 2024 UK study found a life expectancy of 13.2 years for the breed compared to an average of 12.7 for purebreeds and 12 for crossbreeds. Pembroke Welsh Corgis are achondroplastic, meaning they are a "true dwarf" breed. As such, their stature and build can lead to certain non-inherited health conditions, but genetic issues should also be considered. Commonly, Pembrokes can suffer from monorchidism, Von Willebrand\'s disease, hip dysplasia "Hip dysplasia (canine)"), degenerative myelopathy (DM), and inherited eye problems such as progressive retinal atrophy. Genetic testing is available for Pembroke Welsh Corgis to avoid these issues and enhance the genetic health pool. Pembrokes are also prone to obesity given a robust appetite, characteristic of herding group breeds.\nHistory\n[edit]\nWhile the Cardigan Welsh Corgi is thought to originate with the arrival of Celtic culture (around 1200 BCE), the Pembroke Welsh Corgi is more commonly stated to originate with the Flemish plantations#Wales "Plantation (settlement or colony)") that were settled in Pembrokeshire following the Norman Invasion of Wales. These isolated settlements were entirely dependent on the English crown for their survival in Wales and would have brought continental dog breeds such as Pomeranians and schipperke with them. As such, the lineage of the Pembroke Welsh Corgi has been traced back to AD 1107. These breeds, with their agility, smaller stature and shorter legs, were excellent working dogs and were used by both the Flemish and native Welsh to herd of cattle.\nAs show dogs, Pembrokes and Cardigans first appeared together in 1925 when they were shown under the rules of The Kennel Club in Britain. The Corgi Club was founded in December 1925 in Carmarthen, Carmarthenshire. It is reported that the local members favoured the Pembroke breed, so a club for Cardigan enthusiasts was founded a year or so later. Both groups have worked hard to ensure the appearance and type of breed are standardised through careful selective breeding. Pembrokes and Cardigans were officially recognised by the Kennel Club in 1928 and were initially categorised together under the single heading of Welsh Corgis before the two breeds were recognised as separate and distinct in 1934.\nPembroke Welsh Corgis are becoming more popular in the United States and rank 15th (24th) in American Kennel Club registrations, as of 2024 (2012). However, corgis are now listed as a "vulnerable" breed in the United Kingdom; the decline has been said to be due to a 2007 ban on tail-docking (the practice of cutting off the animal\'s tail) in the UK, as well as the lack of breeders in the UK In 2009, the corgi was added to The Kennel Club\'s "At Watch" list of British breeds when annual registrations numbered between 300 and 450. In 2014, the breed was put on the Club\'s "Vulnerable Native Breeds" list when registrations dropped under 300. In 2018, the breed came off the "At-Risk" list with 456 puppies registered in December 2017. The Kennel Club has credited the renewed interest in the breed to the popular Netflix television series, The Crown "The Crown (TV series)"), and others. The Pembroke Welsh Corgi has also appeared in the American television Brooklyn Nine-Nine as the pet dog of Captain Raymond Holt and Kevin M. Cozner and is shown to be extremely loyal. Ein, a Corgi with human-level intelligence, is one of the 5 main characters in the TV show Cowboy Bebop.\nFolklore\n[edit]\nIn Welsh folklore the Corgi is associated with the Tylwyth Teg (Welsh fairies). While there are variations on the story, most state that the dogs were gifted to two human children by the Tywyth Teg. In one version, following a battle between the Tywyth Teg and the Gwyllion (night spirits), two of the Tywyth Teg are killed. Two human children happen upon the procession of the fallen warrior\'s funeral but instead of being unwelcome, the two children are presented with the deceased steeds. Corgis are said to have played the role of war horses for fairies before they became herding dogs for humans. At the base of the haunches of Corgis, there is a line of slightly rougher fur called the fairy saddle.\nActivities\n[edit]\nPembroke Welsh Corgis can compete in dog agility trials, obedience, showmanship, flyball, tracking "Tracking (dog)"), and herding events. Herding instincts and trainability can be measured at noncompetitive herding tests. Corgis, despite their dwarfism giving the illusion of small slow legs, can reach up to 25 mph if they are healthy and fit. This is because Corgis tend to use more upper body strength to run than most dogs, giving them enhanced abilities with such activities as agility and herding and racing.\nRoyal corgis\n[edit]\nMain article: Royal corgis\nAt a young age, the Queen\'s passion for this breed started when her father, King George VI, brought home their first royal corgi who was later named Dookie. The Queen ceased breeding corgis around 2012 so as not to leave any behind after she died; her last corgi, Willow, died in April 2018. She was gifted two new corgi pups by her family in 2021.\nOn 3 April 2019, the film The Queen\'s Corgi was released.\nSee also\n[edit]\n List of dog breeds\nNotes\n[edit]\n1. ^ a b See Wiktionary: corgi § Welsh\nReferences\n[edit]\n1. ^ a b Wheeler, Jill C. (2010). Welsh Corgis. ABDO. p. 6. ISBN "ISBN (identifier)") 978-1-61613-641-3.\n2. ^ "Queen\'s Diamond Jubilee: Just how many dogs does she own?". Christian Science Monitor. 2 June 2012. Retrieved 28 January 2013.\n3. ^ The Kennel Club. "Vulnerable Native Breeds". The Kennel Club. Retrieved 3 July 2016.\n4. ^ Ho, Eric (17 November 2017). "How I Became The Leader Of The New York City Corgi Meet Ups". Medium. Retrieved 19 November 2019.\n5. ^ "THE MOST POPULAR DOG BREEDS OF 2020". Retrieved 19 October 2020.\n6. ^ Richard G. Beauchamp (1999). Welsh Corgis: Pembroke and Cardigan: Everything about Purchase, Care, Nutrition, Grooming, Behavior, and Training. Barron\'s Educational Series. p. 15. ISBN "ISBN (identifier)") 978-0-7641-0557-9.\n7. ^ a b c d "Gale - Product Login". galeapps.gale.com. Retrieved 11 December 2024.\n8. ^ Debra M. Eldredge, DVM (25 February 2009). Pembroke Welsh Corgi: Your Happy Healthy Pet, with DVD. John Wiley & Sons. p. 70. ISBN "ISBN (identifier)") 978-0-470-44364-4.\n9. ^ Debra M. Eldredge, DVM (25 February 2009). Pembroke Welsh Corgi: Your Happy Healthy Pet, with DVD. John Wiley & Sons. p. 17. ISBN "ISBN (identifier)") 978-0-470-44364-4.\n10. ^ Eldredge, Debra M (2009). Pembroke Welsh Corgi: Your Happy Healthy Pet, with DVD. John Wiley & Sons. p. 17. ISBN "ISBN (identifier)") 978-0-470-44364-4.\n11. ^ "PWCCA Standard of Perfection". Archived from the original on 18 January 2015. Retrieved 20 January 2015.\n12. ^ Kennel Clun. "Pembroke Welsh Corg". Archived from the original on 14 June 2012. Retrieved 28 January 2013.\n13. ^ United Kennel Club. "Pembroke Welsh Corgi". Retrieved 28 January 2013.\n14. ^ Cathy Lambert. Getting to Know Poodles: A Guide to Choosing and Owning a Poodle. Animalinfo Publications. p. 15. ISBN "ISBN (identifier)") 978-1-921537-06-6.\n15. ^ "Get to know the Pembroke Welsh Corgi". Archived from the original on 2 August 2009. Retrieved 28 January 2013.\n16. ^ McMillan, Kirsten M.; Bielby, Jon; Williams, Carys L.; Upjohn, Melissa M.; Casey, Rachel A.; Christley, Robert M. (1 February 2024). "Longevity of companion dog breeds: those at risk from early death". Scientific Reports. 14 (1). Springer Science and Business Media LLC: 531. Bibcode "Bibcode (identifier)"):2024NatSR..14..531M. doi "Doi (identifier)"):10.1038/s41598-023-50458-w. ISSN "ISSN (identifier)") 2045-2322. PMC "PMC (identifier)") 10834484. PMID "PMID (identifier)") 38302530.\n17. ^ "From the Genetics Committee of the Pembroke Welsh Corgi Club of America, Inc". Archived from the original on 16 January 2013. Retrieved 28 January 2013.\n18. ^ E. Hywel Burton (18 October 2011). Pembroke Welsh Corgi. Kennel Club Books. p. 116. ISBN "ISBN (identifier)") 978-1-59378-890-2.\n19. ^ "Pembroke Welsh Corgi - HISTORY". Archived from the original on 29 December 2014. Retrieved 28 January 2013.\n20. ^ a b c d e Debra M. Eldredge (27 January 2009). Pembroke Welsh Corgi: Your Happy Healthy Pet, with DVD. John Wiley and Sons. pp. 21–. ISBN "ISBN (identifier)") 978-0-470-39061-0. Retrieved 10 December 2011.\n21. ^ "AKC Dog Registration Statistics". American Kennel Club. Retrieved 27 October 2025.\n22. ^ "Dog Gone! Why You\'re Seeing Fewer Corgis". ABC News. 9 February 2015. Retrieved 8 October 2016.\n23. ^ a b c d "Corgis and the Queen: Celebrating the breed that the Queen made popular". www.thekennelclub.org.uk. Retrieved 4 January 2019.\n24. ^ Rebecca Seales (3 June 2022). "Corgis: How the Queen fell in love and started a phenomenon". BBC News. Retrieved 3 June 2022.\n25. ^ a b Allison, Sarah (2023). "The Fairy Mythology of Corgis". University of Chichester: Gramarye (24): 19–24. ISSN "ISSN (identifier)") 2050-2915.\n26. ^ Hartnagle-Taylor, Jeanne Joy; Taylor, Ty (2010). Stockdog Savvy. Alpine Publications. ISBN "ISBN (identifier)") 978-1-57779-106-5.\n27. ^ "What Are the Queen\'s Corgis Called? All About Elizabeth II\'s Dogs". animalwised.com. Retrieved 24 July 2017.\n28. ^ Wilkes, Joseph (3 December 2020). "Queen left with just one dog as her beloved dorgi Vulcan dies \'of old age\'". The Guardian. Retrieved 18 April 2018.\n29. ^ Corbin, Tianna (20 March 2021). "Queen\'s new corgi pups are named after relative and favourite beauty location". The Cornishman. Retrieved 21 March 2021.\n30. ^ Brazell, Emma (13 June 2021). "Queen \'given corgi puppy\' by Andrew on Philip\'s 100th birthday". Metro. Retrieved 14 June 2021.\n31. ^ "The Queen\'s Last Corgi Is Dead and the Internet Is Inconsolable". Time. Retrieved 10 August 2018.\n Dogs portal\n|  v  t  e  Welsh breeds |\n\n| Dogs |  Pembroke Welsh Corgi  Old Welsh Grey Sheepdog  Black and Tan Terrier  Cardigan Welsh Corgi  Sealyham Terrier  Welsh Corgi  Welsh hillman  Welsh Hound  Welsh Sheepdog  Welsh springer spaniel  Welsh terrier |\n| Cattle |  Glamorgan cattle  Pembroke cattle  Vaynol cattle  Welsh Black cattle |\n| Sheep |  Badger Face Welsh Mountain sheep  Balwen Welsh Mountain sheep  Beulah Speckled Face  Black Welsh Mountain sheep  Brecknock Hill Cheviot  Kerry Hill sheep  Llanwenog sheep  Lleyn sheep  Welsh Mountain sheep |\n| Pig |  Welsh pig |\n| Birds |  Brecon Buff Goose  Welsh Harlequin |\n| Horse |  Welsh Pony and Cob |\n|  v  t  e  Dogs originating in the United Kingdom |\n\n| Hounds |  Beagle  Bloodhound  English Foxhound  Greyhound  Harrier "Harrier (dog breed)")  Otterhound  Scottish Deerhound  Welsh Hound  West Country Harrier  Whippet |\n| Gun dogs |  Clumber Spaniel  Curly-Coated Retriever  English Cocker Spaniel  English Setter  English Springer Spaniel  Field Spaniel  Flat-Coated Retriever  Golden Retriever  Gordon Setter  Labrador Retriever  Pointer "Pointer (dog breed)")  Sussex Spaniel  Welsh Springer Spaniel |\n| Terriers | |  |  |  --- | | Working breeds |  Airedale Terrier  Bedlington Terrier  Border Terrier  Cairn Terrier  Dandie Dinmont Terrier  Jack Russell Terrier  Lakeland Terrier  Manchester Terrier  Norfolk Terrier  Norwich Terrier  Parson Russell Terrier  Patterdale Terrier  Plummer Terrier  Scottish Terrier  Sealyham Terrier  Skye Terrier  Smooth Fox Terrier  Sporting Lucas Terrier  Welsh Terrier  West Highland White Terrier  Wire Fox Terrier | | Toy breeds |  English Toy Terrier (Black & Tan) "English Toy Terrier (Black & Tan)")  Yorkshire Terrier | | Bull types |  Bull and terrier  Bull Terrier  Miniature Bull Terrier  Staffordshire Bull Terrier | |\n| Herding dogs |  Bearded Collie  Border Collie  Cardigan Welsh Corgi  Lancashire Heeler  Old English Sheepdog  Pembroke Welsh Corgi  Rough Collie  Shetland Sheepdog  Smithfield "Smithfield (dog)")  Smooth Collie  Welsh Sheepdog |\n| Other |  Bulldog  Bullmastiff  Cavalier King Charles Spaniel  English Mastiff  King Charles Spaniel  Northern Inuit Dog |\n| Extinct |  Black and Tan Terrier  Blue Paul Terrier  Buckhound  Cumberland Sheepdog  Cur  Dumfriesshire Black and Tan Foxhound  English Water Spaniel  English White Terrier  Norfolk Spaniel  North Country Beagle  Old English Bulldog  Old Welsh Grey Sheepdog  Paisley Terrier  Southern Hound  Sleuth hound  Staghound  Talbot Hound "Talbot (dog breed)")  Toy Bulldog  Toy Trawler Spaniel  Turnspit dog  Tweed Water Spaniel  Welsh Hillman |\n| Types: Collies, Fell Terriers, Fox Terriers, longdogs and lurchers |\n|  v  t  e  Herding and droving dogs |\n\n|  Armant "Armant (dog)")  Australian Cattle Dog  Australian Kelpie  Australian Shepherd  Australian Stumpy Tail Cattle Dog  Basque Shepherd Dog  Bearded Collie  Beauceron  Belgian Shepherd  Bergamasco Shepherd  Berger Picard  Blue Lacy  Bohemian Shepherd  Border Collie  Bouvier des Ardennes  Bouvier des Flandres  Briard  Can de Chira  Cane Lupino del Gigante  Cane di Oropa  Cane Toccatore  Cardigan Welsh Corgi  Carea Castellano Manchego  Carea Leonés  Catahoula Leopard Dog  Catalan Sheepdog  Collie (Rough)  Collie (Smooth)  Croatian Sheepdog  Dutch Shepherd  English Shepherd  Faroese Sheepdog  Finnish Lapphund  Galician Palleiro  Garafian Shepherd  Gaucho sheepdog  German Shepherd  Huntaway  Icelandic Sheepdog  King Shepherd  Koolie  Lancashire Heeler  Lapponian Herder  Magellan sheep dog  McNab dog  Miniature American Shepherd  Mudi  Nenets Herding Laika  New Zealand Heading Dog  Norwegian Buhund  Old English Sheepdog  Old German Herding Dogs (Altdeutsche)  Pastore della Lessinia e del Lagorai  Pembroke Welsh Corgi  Polish Lowland Sheepdog  Portuguese Sheepdog  Puli  Pumi  Pyrenean Sheepdog  Sardinian Shepherd Dog  Schapendoes  Schipperke  Shetland Sheepdog  Small Međimurje Dog  Smithfield "Smithfield (dog)")  Spanish Water Dog  Swedish Lapphund  Swedish Vallhund  Tibetan Terrier  Welsh Sheepdog  White Shepherd  White Swiss Shepherd Dog |\n|  v  t  e  Spitz-type dogs |\n\n| Sled dogs |  Alaskan husky  Alaskan Malamute  Canadian Eskimo Dog  Chinook "Chinook (dog)")  Chukotka sled dog  Eurohound  Greenland Dog  Greyster  Kamchatka Sled Dog  Mackenzie River husky  Samoyed  Siberian Husky  Yakutian Laika  Sakhalin Husky |\n| Hunting dogs |  Black Norwegian Elkhound  East Siberian Laika  Finnish Spitz  Hällefors Elkhound  Hokkaido "Hokkaido (dog)")  Jindo  Kai Ken  Karelian Bear Dog  Karelo-Finnish Laika  Kishu Ken  Norrbottenspets  Norwegian Elkhound  Norwegian Lundehund  Pungsan dog  Russo-European Laika  Shiba Inu  Shikoku  Jämthund  Taiwan Dog  West Siberian Laika  Zerdava |\n| Herding dogs |  Cardigan Welsh Corgi  Finnish Lapphund  Icelandic Sheepdog  Lapponian Herder  Nenets Herding Laika  Norwegian Buhund  Pembroke Welsh Corgi  Swedish Lapphund  Swedish Vallhund |\n| Asian breeds |  Akita "Akita (dog)")  Bắc Hà dog  Chow Chow  Dikkulak  Donggyeongi  Hmong bobtail dog  Indian Spitz  Japanese Spitz  Jeju dog  Kintamani dog  Nureongi  Ryukyu dog  Shar Pei  Thai Bangkaew Dog |\n| Companion dogs |  Alaskan Klee Kai  American Eskimo Dog  Danish Spitz  Eurasier  German Spitz   + Keeshond (Wolfspitz)   + Pomeranian (Zwergspitz)  Northern Inuit Dog  Schipperke  Tonya Finosu  Volpino Italiano |\n| Extinct breeds |  Argentine polar dog  Guejae Gae")  Hare Indian Dog  Hütespitz")  Salish Wool Dog  Tahltan Bear Dog |\n| Types: Husky, Laika "Laika (dog type)"), Tugou |\nRetrieved from ""\nCategories:\n FCI breeds\n Dog breeds originating in Wales\n Herding dogs\n Spitz breeds\nHidden categories:\n Use British English from June 2024\n All Wikipedia articles written in British English\n Use dmy dates from June 2024\n Articles with short description\n Short description matches Wikidata\n Articles with \'species\' microformats\n Wikipedia articles needing clarification from May 2024\n All articles with unsourced statements\n Articles with unsourced statements from June 2023\nPembroke Welsh Corgi\nAdd topic\n</content><|im_end|>\n<|im_start|>assistant\n', prompt_token_id=[151644, 872, 198, 2610, 525, 458, 6203, 2213, 18237, 57294, 304, 9864, 7947, 382, 34528, 397, 26406, 25, 9864, 198, 3030, 943, 25, 5562, 198, 6397, 25, 272, 1775, 72, 198, 3608, 25, 68283, 7441, 45781, 356, 1775, 72, 481, 26587, 320, 2428, 1110, 268, 33366, 2659, 25502, 16341, 8858, 7441, 2763, 301, 927, 920, 1775, 72, 340, 522, 2147, 1339, 27, 8202, 397, 28959, 678, 9760, 1995, 911, 330, 66, 1775, 72, 1, 504, 279, 2213, 3685, 382, 13819, 389, 510, 16, 13, 434, 11944, 1995, 320, 9535, 7029, 11, 12713, 11, 32372, 11, 33799, 340, 17, 13, 68568, 320, 14623, 1865, 432, 11, 879, 5711, 432, 11, 1128, 432, 594, 5435, 311, 340, 18, 13, 9608, 323, 25361, 2878, 279, 9864, 7947, 198, 19, 13, 5765, 4911, 476, 27190, 3565, 271, 3430, 15817, 714, 63594, 13, 8278, 2924, 1995, 429, 374, 5961, 9760, 311, 330, 66, 1775, 72, 1, 304, 279, 2266, 315, 9864, 382, 65354, 304, 4718, 3561, 510, 515, 220, 330, 1708, 788, 330, 874, 52899, 12126, 1588, 756, 220, 330, 792, 761, 11359, 788, 4383, 33110, 16, 497, 330, 33110, 17, 497, 2503, 1259, 220, 330, 9721, 47377, 788, 4383, 2996, 16, 497, 330, 2996, 17, 497, 2503, 921, 532, 522, 8202, 1339, 27, 1796, 397, 33979, 311, 2213, 198, 5890, 198, 14803, 198, 320, 5366, 340, 220, 16, 7662, 198, 10, 220, 16, 13, 16, 60616, 198, 10, 220, 16, 13, 17, 74683, 2838, 198, 220, 17, 6267, 198, 220, 18, 11099, 198, 220, 19, 64237, 20156, 198, 220, 20, 43282, 198, 220, 21, 16194, 272, 1775, 285, 198, 220, 22, 3496, 1083, 198, 220, 23, 18068, 198, 220, 24, 44078, 198, 47, 8858, 7441, 45781, 356, 1775, 72, 198, 63471, 33594, 3038, 133178, 79012, 198, 31444, 6362, 198, 9843, 234, 68, 84478, 2210, 198, 422, 40774, 198, 33315, 198, 468, 53483, 198, 142658, 198, 45577, 35038, 20064, 14391, 198, 138861, 198, 130092, 31079, 198, 220, 146226, 144925, 145680, 145265, 145160, 145265, 145175, 198, 31329, 15428, 23968, 198, 14811, 78, 198, 220, 146482, 145395, 145608, 145989, 145974, 145702, 145302, 198, 9926, 63419, 11645, 84, 198, 128748, 55057, 198, 31329, 15428, 386, 6895, 84, 198, 451, 7294, 8166, 198, 75402, 21894, 102819, 198, 451, 81587, 293, 562, 76, 86504, 198, 451, 81587, 308, 1872, 81587, 198, 57719, 6642, 198, 22234, 84, 36830, 198, 74267, 198, 27499, 2184, 8005, 79012, 608, 18962, 1690, 6642, 198, 33588, 1690, 74, 2267, 10553, 1862, 6642, 608, 5409, 2184, 8005, 133981, 10474, 2184, 127470, 79012, 198, 16931, 21441, 198, 86173, 4554, 198, 22325, 26068, 968, 128324, 198, 72858, 16744, 198, 4036, 7746, 198, 13355, 198, 18976, 198, 4457, 198, 8340, 198, 2738, 3840, 198, 16583, 198, 12948, 198, 4457, 198, 8340, 198, 2738, 3840, 198, 15415, 198, 3555, 7746, 1588, 198, 24369, 4344, 198, 24996, 1034, 198, 56216, 2656, 198, 5755, 1995, 198, 356, 632, 419, 2150, 198, 2126, 65563, 5548, 198, 8577, 38699, 2038, 198, 8994, 66948, 198, 8577, 438, 11358, 198, 64753, 2319, 198, 641, 1008, 7079, 198, 89840, 25585, 198, 42105, 81080, 1509, 198, 29227, 198, 3830, 26587, 11, 279, 1910, 82608, 198, 48940, 27775, 198, 91, 68283, 7441, 45781, 356, 1775, 72, 35721, 91, 7718, 15988, 11400, 760, 356, 1775, 72, 11, 45781, 356, 1775, 72, 11, 68283, 7441, 9248, 91, 17116, 760, 22931, 9248, 91, 760, 67026, 760, 220, 760, 21432, 760, 386, 3831, 760, 220, 16, 15, 4142, 16, 17, 304, 320, 17, 20, 4142, 18, 15, 9961, 8, 760, 760, 34195, 3831, 760, 220, 16, 15, 4142, 16, 17, 304, 320, 17, 20, 4142, 18, 15, 9961, 8, 760, 760, 16516, 760, 386, 3831, 760, 220, 17, 19, 4142, 18, 16, 18866, 320, 16, 16, 4142, 16, 19, 20972, 8, 760, 760, 34195, 3831, 760, 220, 17, 19, 4142, 17, 23, 18866, 320, 16, 16, 4142, 16, 18, 20972, 8, 760, 760, 67767, 760, 24355, 3084, 11, 12045, 11, 9104, 11588, 380, 1990, 22875, 760, 760, 3478, 760, 434, 6379, 11, 5235, 609, 24548, 11, 5235, 609, 5807, 11, 3731, 11, 328, 480, 760, 9248, 91, 760, 15378, 301, 6335, 10659, 760, 220, 760, 576, 15378, 301, 10140, 760, 5297, 760, 760, 434, 15083, 52201, 356, 1872, 1609, 2372, 4414, 37035, 760, 5297, 760, 9248, 91, 14254, 320, 5600, 9826, 5562, 8, 9248, 785, 68283, 7441, 45781, 356, 1775, 72, 46225, 144936, 74, 145347, 145231, 81, 145958, 72, 14, 26, 45781, 369, 330, 67, 32634, 5562, 899, 374, 264, 35852, 1059, 6968, 5562, 27775, 429, 43753, 304, 393, 48910, 74, 89245, 11, 22931, 13, 576, 829, 356, 1775, 72, 374, 315, 45781, 6238, 11, 323, 374, 264, 23628, 315, 279, 4244, 1829, 323, 11825, 320, 6984, 657, 311, 13535, 701, 7290, 330, 67, 32634, 1, 323, 330, 18457, 497, 15576, 13, 1084, 374, 825, 315, 1378, 57145, 3881, 438, 264, 45781, 356, 1775, 72, 11, 279, 1008, 1660, 279, 6795, 10881, 45781, 356, 1775, 72, 13, 68283, 7441, 45781, 356, 1775, 285, 525, 57742, 504, 279, 3089, 11042, 2997, 315, 5562, 624, 47, 8858, 7441, 45781, 356, 1775, 285, 525, 11245, 438, 279, 14890, 27775, 315, 16259, 20731, 7946, 11, 879, 12938, 803, 1091, 220, 18, 15, 16194, 272, 1775, 285, 2337, 1059, 30302, 13, 10328, 1493, 12590, 614, 1012, 91767, 553, 7855, 52717, 369, 803, 1091, 69949, 1635, 11, 4221, 279, 7855, 584, 807, 614, 5926, 20866, 1119, 17704, 304, 3793, 315, 22538, 323, 7479, 13, 4354, 11, 807, 7146, 1602, 5411, 304, 279, 3639, 4180, 13, 37273, 1741, 438, 1532, 4261, 11, 10196, 11, 9656, 11902, 11, 323, 5836, 12879, 3331, 9775, 330, 34, 1775, 72, 25826, 8602, 1, 304, 892, 11499, 315, 12590, 323, 862, 7824, 390, 14240, 311, 8329, 279, 1899, 624, 785, 68283, 7441, 45781, 356, 1775, 72, 702, 1012, 21006, 220, 16, 16, 339, 304, 30452, 9518, 77, 594, 576, 21392, 315, 38425, 11, 892, 5302, 429, 279, 27775, 374, 6509, 458, 9073, 3238, 5562, 13, 68283, 7441, 45781, 356, 1775, 285, 1033, 21006, 220, 16, 16, 339, 1429, 5411, 27775, 315, 5562, 304, 220, 17, 15, 17, 15, 4092, 311, 279, 3693, 15378, 301, 10140, 624, 5009, 198, 58, 3587, 921, 29227, 198, 58, 3587, 921, 47, 8858, 7441, 45781, 356, 1775, 285, 1745, 504, 279, 6795, 10881, 45781, 356, 1775, 72, 553, 1660, 23327, 304, 3084, 11, 3432, 9155, 24230, 11, 323, 1660, 10078, 7678, 261, 315, 2472, 624, 785, 68283, 7441, 45781, 356, 1775, 72, 702, 37632, 24230, 429, 525, 304, 21117, 311, 279, 3232, 42939, 21495, 315, 279, 1968, 13, 576, 27775, 5297, 14807, 429, 279, 24230, 1265, 387, 7474, 11, 11051, 304, 1379, 11, 323, 94055, 10078, 311, 264, 17976, 1459, 13, 576, 1968, 1265, 387, 330, 15011, 12681, 1, 304, 6083, 323, 11094, 13, 576, 68283, 7441, 27775, 5990, 49442, 2163, 220, 17, 17, 481, 220, 17, 22, 28060, 7, 16, 15, 311, 220, 16, 17, 15045, 436, 568, 2379, 3545, 6629, 1948, 220, 23, 311, 220, 16, 17, 14924, 11, 476, 220, 17, 15, 311, 220, 18, 15, 2889, 54236, 11, 323, 389, 5461, 11, 3887, 311, 387, 2163, 220, 16, 18, 1635, 2310, 624, 33060, 311, 279, 68283, 7441, 45781, 356, 1775, 72, 3432, 264, 1990, 22875, 11, 807, 24354, 16916, 678, 1042, 4778, 11, 448, 38935, 304, 279, 10464, 323, 41674, 13, 3085, 5792, 76726, 11, 862, 22875, 374, 14138, 4135, 311, 10306, 11, 438, 1632, 438, 17712, 3015, 12, 323, 25284, 87774, 306, 320, 266, 279, 4683, 315, 330, 1489, 1362, 550, 17135, 12821, 2404, 4362, 936, 1333, 531, 27485, 525, 1083, 3881, 311, 24354, 2337, 8628, 13, 10964, 22875, 702, 14400, 29573, 64072, 389, 1817, 3108, 315, 279, 448, 388, 8881, 553, 4344, 304, 279, 25755, 11, 3084, 11, 323, 5106, 315, 6869, 6513, 13, 576, 68283, 7441, 22875, 1083, 34227, 304, 1894, 11, 2087, 504, 264, 62144, 812, 11, 476, 1496, 9278, 1894, 11, 311, 13876, 323, 3691, 13, 31844, 448, 1493, 60369, 7987, 11, 862, 55637, 686, 1083, 7025, 6644, 264, 2341, 377, 2718, 315, 4158, 18773, 624, 33, 28516, 56690, 3000, 323, 1265, 537, 387, 54087, 389, 7428, 26, 1741, 438, 272, 1775, 285, 448, 264, 1602, 1293, 323, 64255, 22875, 5001, 504, 264, 46762, 533, 14862, 323, 2518, 55637, 3042, 448, 264, 1501, 50120, 6311, 892, 614, 264, 79603, 12463, 624, 7983, 1045, 700, 6711, 68283, 7441, 45781, 356, 1775, 285, 525, 9223, 448, 862, 9787, 17712, 2805, 11, 279, 8686, 3545, 614, 862, 63514, 27549, 291, 330, 41468, 287, 320, 18457, 68191, 1948, 220, 17, 4142, 20, 2849, 2310, 4152, 311, 13656, 13815, 476, 311, 25879, 311, 279, 74152, 11766, 13, 58194, 88210, 572, 537, 4362, 369, 279, 5562, 311, 653, 1181, 2618, 438, 264, 1059, 6968, 5562, 304, 279, 3639, 15072, 438, 1657, 3717, 320, 11284, 6795, 10881, 45781, 272, 1775, 285, 1033, 1083, 1059, 6968, 12590, 714, 2581, 27549, 291, 8, 714, 4751, 1576, 264, 2477, 12, 1923, 6968, 5562, 572, 6509, 264, 19352, 1212, 3742, 2329, 323, 28023, 264, 3742, 11, 773, 311, 19869, 429, 862, 12590, 1033, 1059, 6968, 12590, 11, 7824, 1030, 311, 5978, 279, 12590, 1030, 27549, 291, 63514, 7873, 83147, 4362, 60, 576, 15378, 301, 10140, 11, 279, 3639, 15378, 301, 10140, 11, 323, 279, 434, 11237, 2138, 34439, 63514, 304, 1200, 1627, 4933, 13, 576, 30572, 34, 11766, 5302, 63514, 1265, 387, 27549, 291, 902, 5021, 1091, 220, 17, 14924, 320, 20, 9961, 568, 758, 1657, 5837, 2670, 279, 3639, 15072, 11, 88210, 702, 1012, 24636, 11816, 624, 21988, 712, 2838, 198, 58, 3587, 921, 47, 8858, 7441, 45781, 356, 1775, 285, 2948, 311, 387, 6398, 304, 279, 2997, 11, 323, 8376, 311, 1795, 27478, 862, 7824, 728, 13, 2379, 614, 264, 2244, 12591, 311, 4486, 862, 7824, 11, 8450, 3259, 1105, 23541, 311, 3960, 323, 5426, 13, 576, 12590, 646, 1083, 387, 17003, 311, 5426, 4152, 311, 862, 3238, 4004, 11, 51396, 2090, 323, 11229, 1365, 807, 1033, 21006, 438, 279, 10510, 44607, 1429, 24514, 5562, 304, 30452, 9518, 77, 594, 576, 21392, 315, 38425, 13, 30809, 1059, 6968, 11, 807, 1083, 729, 438, 46911, 82, 4152, 311, 862, 5115, 2090, 323, 30854, 311, 53742, 11, 892, 646, 387, 62268, 421, 807, 525, 537, 80371, 48572, 13, 7496, 393, 48910, 12556, 686, 5931, 279, 6529, 315, 5019, 807, 3367, 323, 35692, 1632, 2163, 2841, 323, 1008, 25103, 13, 1084, 374, 2989, 311, 3590, 1064, 419, 27775, 448, 1008, 9898, 11, 12598, 11, 323, 2841, 979, 807, 525, 1602, 3908, 311, 5648, 894, 7147, 42029, 16999, 476, 39207, 2937, 304, 2272, 13, 13293, 3166, 311, 2506, 304, 3971, 374, 429, 448, 419, 1184, 369, 40859, 11, 807, 1083, 614, 264, 1184, 369, 10158, 11, 438, 807, 646, 6707, 3635, 49154, 13, 2379, 2948, 311, 1598, 2163, 323, 4078, 19766, 11, 323, 4152, 311, 862, 1059, 6968, 323, 1365, 369, 1045, 1365, 36593, 30555, 11, 807, 2948, 311, 32486, 4113, 429, 10797, 11, 773, 432, 374, 1850, 311, 2506, 1105, 4766, 83393, 5671, 13, 576, 1059, 6968, 30555, 686, 1083, 5240, 1045, 14650, 393, 48910, 12556, 311, 98470, 518, 862, 7824, 6, 89613, 438, 419, 374, 1128, 807, 1033, 54087, 311, 653, 448, 35852, 624, 14542, 198, 58, 3587, 921, 32, 220, 17, 15, 17, 19, 6424, 3920, 1730, 264, 2272, 65895, 315, 220, 16, 18, 13, 17, 1635, 369, 279, 27775, 7707, 311, 458, 5461, 315, 220, 16, 17, 13, 22, 369, 10526, 20512, 6767, 323, 220, 16, 17, 369, 5312, 20512, 6767, 13, 68283, 7441, 45781, 356, 1775, 285, 525, 33261, 2111, 299, 500, 5064, 11, 7290, 807, 525, 264, 330, 1866, 49461, 1, 27775, 13, 1634, 1741, 11, 862, 76623, 323, 1936, 646, 2990, 311, 3654, 2477, 3419, 48394, 2820, 4682, 11, 714, 18929, 4714, 1265, 1083, 387, 6509, 13, 7718, 398, 11, 393, 48910, 12556, 646, 7676, 504, 1615, 21584, 307, 2142, 11, 42079, 467, 4517, 13473, 594, 8457, 11, 18143, 21943, 500, 35159, 330, 90538, 21943, 500, 35159, 320, 4814, 482, 8, 3975, 5254, 74889, 847, 301, 52942, 320, 8395, 701, 323, 26990, 7912, 5322, 1741, 438, 22257, 2112, 977, 518, 57075, 13, 74126, 7497, 374, 2500, 369, 68283, 7441, 45781, 356, 1775, 285, 311, 5648, 1493, 4714, 323, 18379, 279, 18929, 2820, 7314, 13, 393, 48910, 12556, 525, 1083, 36997, 311, 31948, 2661, 264, 21765, 37475, 11, 28583, 315, 1059, 6968, 1874, 57145, 624, 13424, 198, 58, 3587, 921, 7983, 279, 6795, 10881, 45781, 356, 1775, 72, 374, 3381, 311, 81216, 448, 279, 18647, 315, 54664, 7674, 320, 19454, 220, 16, 17, 15, 15, 78577, 701, 279, 68283, 7441, 45781, 356, 1775, 72, 374, 803, 16626, 10982, 311, 81216, 448, 279, 64022, 812, 6008, 804, 2, 54, 3831, 330, 54647, 367, 320, 746, 44489, 476, 40936, 68191, 429, 1033, 22378, 304, 393, 48910, 74, 89245, 2701, 279, 40068, 94404, 315, 22931, 13, 4220, 24203, 44604, 1033, 11368, 17749, 389, 279, 6364, 26533, 369, 862, 19661, 304, 22931, 323, 1035, 614, 7117, 57536, 5562, 57145, 1741, 438, 393, 25359, 276, 5380, 323, 5699, 573, 712, 440, 448, 1105, 13, 1634, 1741, 11, 279, 63909, 315, 279, 68283, 7441, 45781, 356, 1775, 72, 702, 1012, 50300, 1182, 311, 9630, 220, 16, 16, 15, 22, 13, 4220, 57145, 11, 448, 862, 66641, 11, 9155, 76623, 323, 23327, 14201, 11, 1033, 9073, 3238, 12590, 323, 1033, 1483, 553, 2176, 279, 64022, 812, 323, 9867, 45781, 311, 58113, 315, 35852, 624, 2121, 1473, 12590, 11, 393, 48910, 12556, 323, 6795, 75757, 1156, 9723, 3786, 304, 220, 16, 24, 17, 20, 979, 807, 1033, 6839, 1212, 279, 5601, 315, 576, 15378, 301, 10140, 304, 13224, 13, 576, 356, 1775, 72, 10140, 572, 18047, 304, 6652, 220, 16, 24, 17, 20, 304, 34452, 277, 3391, 11, 34452, 46501, 724, 34448, 13, 1084, 374, 4961, 429, 279, 2205, 3613, 91767, 279, 68283, 7441, 27775, 11, 773, 264, 6335, 369, 6795, 10881, 42348, 572, 18047, 264, 1042, 476, 773, 2937, 13, 11733, 5203, 614, 6439, 2588, 311, 5978, 279, 11094, 323, 943, 315, 27775, 525, 5297, 4056, 1526, 16585, 42910, 39208, 13, 393, 48910, 12556, 323, 6795, 75757, 1033, 18562, 38664, 553, 279, 15378, 301, 10140, 304, 220, 16, 24, 17, 23, 323, 1033, 15102, 22049, 4056, 3786, 1212, 279, 3175, 14496, 315, 45781, 356, 1775, 285, 1573, 279, 1378, 57145, 1033, 38664, 438, 8651, 323, 12460, 304, 220, 16, 24, 18, 19, 624, 47, 8858, 7441, 45781, 356, 1775, 285, 525, 10454, 803, 5411, 304, 279, 3639, 4180, 323, 7077, 220, 16, 20, 339, 320, 17, 19, 339, 8, 304, 3693, 15378, 301, 10140, 69490, 11, 438, 315, 220, 17, 15, 17, 19, 320, 17, 15, 16, 17, 568, 4354, 11, 272, 1775, 285, 525, 1431, 10007, 438, 264, 330, 85, 92907, 1, 27775, 304, 279, 3639, 15072, 26, 279, 17704, 702, 1012, 1053, 311, 387, 4152, 311, 264, 220, 17, 15, 15, 22, 8943, 389, 9787, 1737, 70091, 320, 1782, 6588, 315, 14376, 1007, 279, 9864, 594, 9787, 8, 304, 279, 6424, 11, 438, 1632, 438, 279, 6853, 315, 27775, 388, 304, 279, 6424, 758, 220, 17, 15, 15, 24, 11, 279, 272, 1775, 72, 572, 3694, 311, 576, 15378, 301, 10140, 594, 330, 1655, 10357, 1, 1140, 315, 7855, 57145, 979, 9775, 69490, 48826, 1948, 220, 18, 15, 15, 323, 220, 19, 20, 15, 13, 758, 220, 17, 15, 16, 19, 11, 279, 27775, 572, 2182, 389, 279, 10140, 594, 330, 53, 92907, 16703, 11427, 6767, 1, 1140, 979, 69490, 12226, 1212, 220, 18, 15, 15, 13, 758, 220, 17, 15, 16, 23, 11, 279, 27775, 3697, 1007, 279, 330, 1655, 10911, 3187, 1, 1140, 448, 220, 19, 20, 21, 56625, 9681, 304, 6652, 220, 17, 15, 16, 22, 13, 576, 15378, 301, 10140, 702, 40757, 279, 35546, 2734, 304, 279, 27775, 311, 279, 5411, 22642, 12425, 4013, 11, 576, 28643, 330, 785, 28643, 320, 15653, 4013, 8, 3975, 323, 3800, 13, 576, 68283, 7441, 45781, 356, 1775, 72, 702, 1083, 9723, 304, 279, 3693, 12425, 25748, 37066, 11250, 482, 438, 279, 6753, 5562, 315, 21316, 42570, 58906, 323, 16364, 386, 13, 3539, 89, 1194, 323, 374, 6839, 311, 387, 9016, 28847, 13, 18069, 11, 264, 356, 1775, 72, 448, 3738, 11591, 11229, 11, 374, 825, 315, 279, 220, 20, 1887, 5766, 304, 279, 5883, 1473, 95022, 2823, 65, 453, 624, 37, 22604, 20156, 198, 58, 3587, 921, 641, 45781, 97869, 279, 356, 1775, 72, 374, 5815, 448, 279, 350, 3923, 22545, 339, 350, 791, 320, 83516, 927, 6624, 550, 568, 5976, 1052, 525, 26244, 389, 279, 3364, 11, 1429, 1584, 429, 279, 12590, 1033, 46780, 311, 1378, 3738, 2841, 553, 279, 13897, 22545, 339, 350, 791, 13, 758, 825, 2319, 11, 2701, 264, 8049, 1948, 279, 13897, 22545, 339, 350, 791, 323, 279, 479, 22545, 654, 290, 320, 9287, 30639, 701, 1378, 315, 279, 13897, 22545, 339, 350, 791, 525, 7425, 13, 9043, 3738, 2841, 3537, 5193, 279, 83714, 315, 279, 20866, 37390, 594, 30979, 714, 4518, 315, 1660, 15025, 5717, 11, 279, 1378, 2841, 525, 10449, 448, 279, 42620, 4087, 6767, 13, 356, 1775, 285, 525, 1053, 311, 614, 6342, 279, 3476, 315, 4116, 26830, 369, 6624, 550, 1573, 807, 6116, 1059, 6968, 12590, 369, 12677, 13, 2411, 279, 2331, 315, 279, 6386, 3185, 288, 315, 356, 1775, 285, 11, 1052, 374, 264, 1555, 315, 10078, 11165, 261, 18241, 2598, 279, 44486, 60758, 624, 67820, 198, 58, 3587, 921, 47, 8858, 7441, 45781, 356, 1775, 285, 646, 20259, 304, 5562, 66641, 19080, 11, 66094, 11, 1473, 57732, 11, 11466, 3959, 11, 14849, 330, 37119, 320, 18457, 8, 3975, 323, 1059, 6968, 4357, 13, 6252, 6968, 61821, 323, 5426, 2897, 646, 387, 16878, 518, 2477, 92399, 1059, 6968, 7032, 13, 356, 1775, 285, 11, 8818, 862, 49461, 2142, 7086, 279, 40819, 315, 2613, 6301, 14201, 11, 646, 5545, 705, 311, 220, 17, 20, 33961, 421, 807, 525, 9314, 323, 4946, 13, 1096, 374, 1576, 356, 1775, 285, 8376, 311, 990, 803, 8416, 2487, 8170, 311, 1598, 1091, 1429, 12590, 11, 7086, 1105, 23922, 17541, 448, 1741, 7488, 438, 66641, 323, 1059, 6968, 323, 21313, 624, 73772, 272, 1775, 285, 198, 58, 3587, 921, 6202, 4549, 25, 16194, 272, 1775, 285, 198, 1655, 264, 3908, 4231, 11, 279, 16259, 594, 11677, 369, 419, 27775, 3855, 979, 1059, 6981, 11, 6210, 9857, 29668, 11, 7117, 2114, 862, 1156, 29236, 272, 1775, 72, 879, 572, 2937, 6941, 422, 9619, 13, 576, 16259, 58377, 39208, 272, 1775, 285, 2163, 220, 17, 15, 16, 17, 773, 438, 537, 311, 5274, 894, 4815, 1283, 1340, 8469, 26, 1059, 1537, 272, 1775, 72, 11, 64349, 11, 8469, 304, 5813, 220, 17, 15, 16, 23, 13, 2932, 572, 46780, 1378, 501, 272, 1775, 72, 89721, 553, 1059, 2997, 304, 220, 17, 15, 17, 16, 624, 1925, 220, 18, 5813, 220, 17, 15, 16, 24, 11, 279, 4531, 576, 16259, 594, 356, 1775, 72, 572, 5880, 624, 9830, 1083, 198, 58, 3587, 921, 1759, 315, 5562, 57145, 198, 21667, 198, 58, 3587, 921, 16, 13, 6306, 264, 293, 3496, 42105, 27391, 658, 25, 272, 1775, 72, 16625, 45781, 198, 31712, 198, 58, 3587, 921, 16, 13, 6306, 264, 293, 60346, 11, 47211, 356, 13, 320, 17, 15, 16, 15, 568, 45781, 356, 1775, 285, 13, 14137, 5865, 13, 281, 13, 220, 21, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 16, 12, 21, 16, 21, 16, 18, 12, 21, 19, 16, 12, 18, 624, 17, 13, 6306, 330, 52006, 594, 24334, 79280, 63066, 25, 4599, 1246, 1657, 12590, 1558, 1340, 1828, 30, 3263, 8876, 9965, 23519, 13, 220, 17, 5534, 220, 17, 15, 16, 17, 13, 57791, 220, 17, 23, 6058, 220, 17, 15, 16, 18, 624, 18, 13, 6306, 576, 15378, 301, 10140, 13, 330, 53, 92907, 16703, 11427, 6767, 3263, 576, 15378, 301, 10140, 13, 57791, 220, 18, 5768, 220, 17, 15, 16, 21, 624, 19, 13, 6306, 17275, 11, 16247, 320, 16, 22, 6702, 220, 17, 15, 16, 22, 568, 330, 4340, 358, 90044, 576, 23030, 4940, 576, 1532, 4261, 4311, 356, 1775, 72, 25826, 71316, 3263, 24355, 13, 57791, 220, 16, 24, 6702, 220, 17, 15, 16, 24, 624, 20, 13, 6306, 330, 17229, 79099, 45728, 7081, 9319, 38, 80562, 1479, 50, 3008, 220, 17, 15, 17, 15, 3263, 57791, 220, 16, 24, 6527, 220, 17, 15, 17, 15, 624, 21, 13, 6306, 11867, 479, 13, 60714, 1387, 1121, 320, 16, 24, 24, 24, 568, 45781, 356, 1775, 285, 25, 68283, 7441, 323, 6795, 10881, 25, 20094, 911, 30988, 11, 10627, 11, 38600, 11, 479, 2966, 287, 11, 26675, 11, 323, 16151, 13, 31717, 263, 594, 45845, 11131, 13, 281, 13, 220, 16, 20, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 15, 12, 22, 21, 19, 16, 12, 15, 20, 20, 22, 12, 24, 624, 22, 13, 6306, 264, 293, 272, 294, 330, 38, 1574, 481, 5643, 8779, 3263, 342, 1574, 27635, 1302, 1574, 905, 13, 57791, 220, 16, 16, 6652, 220, 17, 15, 17, 19, 624, 23, 13, 6306, 1581, 14383, 386, 13, 26867, 1151, 709, 11, 422, 11187, 320, 17, 20, 7400, 220, 17, 15, 15, 24, 568, 68283, 7441, 45781, 356, 1775, 72, 25, 4615, 23355, 43354, 11333, 11, 448, 18092, 13, 3757, 74802, 609, 50738, 13, 281, 13, 220, 22, 15, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 15, 12, 19, 22, 15, 12, 19, 19, 18, 21, 19, 12, 19, 624, 24, 13, 6306, 1581, 14383, 386, 13, 26867, 1151, 709, 11, 422, 11187, 320, 17, 20, 7400, 220, 17, 15, 15, 24, 568, 68283, 7441, 45781, 356, 1775, 72, 25, 4615, 23355, 43354, 11333, 11, 448, 18092, 13, 3757, 74802, 609, 50738, 13, 281, 13, 220, 16, 22, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 15, 12, 19, 22, 15, 12, 19, 19, 18, 21, 19, 12, 19, 624, 16, 15, 13, 6306, 26867, 1151, 709, 11, 1581, 14383, 386, 320, 17, 15, 15, 24, 568, 68283, 7441, 45781, 356, 1775, 72, 25, 4615, 23355, 43354, 11333, 11, 448, 18092, 13, 3757, 74802, 609, 50738, 13, 281, 13, 220, 16, 22, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 15, 12, 19, 22, 15, 12, 19, 19, 18, 21, 19, 12, 19, 624, 16, 16, 13, 6306, 330, 68123, 94307, 11766, 315, 3616, 13120, 3263, 97750, 504, 279, 4024, 389, 220, 16, 23, 6058, 220, 17, 15, 16, 20, 13, 57791, 220, 17, 15, 6058, 220, 17, 15, 16, 20, 624, 16, 17, 13, 6306, 15378, 301, 2435, 359, 13, 330, 47, 8858, 7441, 45781, 356, 1775, 3263, 97750, 504, 279, 4024, 389, 220, 16, 19, 5534, 220, 17, 15, 16, 17, 13, 57791, 220, 17, 23, 6058, 220, 17, 15, 16, 18, 624, 16, 18, 13, 6306, 3639, 15378, 301, 10140, 13, 330, 47, 8858, 7441, 45781, 356, 1775, 72, 3263, 57791, 220, 17, 23, 6058, 220, 17, 15, 16, 18, 624, 16, 19, 13, 6306, 81348, 69543, 13, 24515, 311, 14187, 393, 97121, 25, 362, 12712, 311, 76251, 323, 40796, 1229, 264, 393, 30607, 13, 21292, 2733, 61670, 13, 281, 13, 220, 16, 20, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 16, 12, 24, 17, 16, 20, 18, 22, 12, 15, 21, 12, 21, 624, 16, 20, 13, 6306, 330, 1949, 311, 1414, 279, 68283, 7441, 45781, 356, 1775, 72, 3263, 97750, 504, 279, 4024, 389, 220, 17, 6156, 220, 17, 15, 15, 24, 13, 57791, 220, 17, 23, 6058, 220, 17, 15, 16, 18, 624, 16, 21, 13, 6306, 4483, 12328, 276, 11, 80677, 268, 386, 15642, 12100, 301, 1694, 11, 12285, 26, 13612, 11, 91564, 82, 444, 15642, 3138, 47817, 11, 47048, 386, 15642, 44524, 11, 31432, 362, 15642, 3686, 3179, 11, 8397, 386, 13, 320, 16, 7400, 220, 17, 15, 17, 19, 568, 330, 6583, 51679, 315, 21741, 5562, 57145, 25, 1846, 518, 5214, 504, 4124, 4545, 3263, 37030, 28040, 13, 220, 16, 19, 320, 16, 568, 66815, 9965, 323, 8025, 7816, 15262, 25, 220, 20, 18, 16, 13, 29445, 1851, 330, 33, 579, 1851, 320, 15909, 8, 37051, 17, 15, 17, 19, 65214, 14557, 496, 16, 19, 496, 20, 18, 16, 44, 13, 35895, 330, 5404, 72, 320, 15909, 8, 37051, 16, 15, 13, 16, 15, 18, 23, 2687, 19, 16, 20, 24, 23, 12, 15, 17, 18, 12, 20, 15, 19, 20, 23, 2630, 13, 86686, 330, 30849, 45, 320, 15909, 68191, 220, 17, 15, 19, 20, 12, 17, 18, 17, 17, 13, 87032, 330, 92523, 320, 15909, 68191, 220, 16, 15, 23, 18, 19, 19, 23, 19, 13, 60941, 330, 8795, 915, 320, 15909, 68191, 220, 18, 23, 18, 15, 17, 20, 18, 15, 624, 16, 22, 13, 6306, 330, 3830, 279, 83286, 10341, 315, 279, 68283, 7441, 45781, 356, 1775, 72, 10140, 315, 5159, 11, 4848, 3263, 97750, 504, 279, 4024, 389, 220, 16, 21, 6058, 220, 17, 15, 16, 18, 13, 57791, 220, 17, 23, 6058, 220, 17, 15, 16, 18, 624, 16, 23, 13, 6306, 468, 13, 10112, 89463, 53655, 320, 16, 23, 6527, 220, 17, 15, 16, 16, 568, 68283, 7441, 45781, 356, 1775, 72, 13, 15378, 301, 10140, 17833, 13, 281, 13, 220, 16, 16, 21, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 16, 12, 20, 24, 18, 22, 23, 12, 23, 24, 15, 12, 17, 624, 16, 24, 13, 6306, 330, 47, 8858, 7441, 45781, 356, 1775, 72, 481, 61779, 3263, 97750, 504, 279, 4024, 389, 220, 17, 24, 6652, 220, 17, 15, 16, 19, 13, 57791, 220, 17, 23, 6058, 220, 17, 15, 16, 18, 624, 17, 15, 13, 6306, 264, 293, 272, 294, 384, 1581, 14383, 386, 13, 26867, 1151, 709, 320, 17, 22, 6058, 220, 17, 15, 15, 24, 568, 68283, 7441, 45781, 356, 1775, 72, 25, 4615, 23355, 43354, 11333, 11, 448, 18092, 13, 3757, 74802, 323, 50738, 13, 11823, 13, 220, 17, 16, 4142, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 15, 12, 19, 22, 15, 12, 18, 24, 15, 21, 16, 12, 15, 13, 57791, 220, 16, 15, 6652, 220, 17, 15, 16, 16, 624, 17, 16, 13, 6306, 330, 11907, 34, 14254, 24516, 24624, 3263, 3693, 15378, 301, 10140, 13, 57791, 220, 17, 22, 6527, 220, 17, 15, 17, 20, 624, 17, 17, 13, 6306, 330, 48940, 55255, 0, 8429, 1446, 2299, 55024, 42915, 261, 356, 1775, 285, 3263, 19360, 5398, 13, 220, 24, 7400, 220, 17, 15, 16, 20, 13, 57791, 220, 23, 6527, 220, 17, 15, 16, 21, 624, 17, 18, 13, 6306, 264, 293, 272, 294, 330, 34, 1775, 285, 323, 279, 16259, 25, 32192, 1095, 279, 27775, 429, 279, 16259, 1865, 5411, 3263, 8438, 13677, 1225, 2667, 301, 19862, 2659, 15194, 13, 57791, 220, 19, 6058, 220, 17, 15, 16, 24, 624, 17, 19, 13, 6306, 44457, 1345, 3831, 320, 18, 5534, 220, 17, 15, 17, 17, 568, 330, 34, 1775, 285, 25, 2585, 279, 16259, 11052, 304, 2948, 323, 3855, 264, 24844, 3263, 18096, 5398, 13, 57791, 220, 18, 5534, 220, 17, 15, 17, 17, 624, 17, 20, 13, 6306, 264, 293, 62408, 11, 20445, 320, 17, 15, 17, 18, 568, 330, 785, 55076, 46495, 2449, 315, 356, 1775, 285, 3263, 3822, 315, 910, 12063, 3667, 25, 28837, 658, 68, 320, 17, 19, 1648, 220, 16, 24, 4142, 17, 19, 13, 86686, 330, 30849, 45, 320, 15909, 68191, 220, 17, 15, 20, 15, 12, 17, 24, 16, 20, 624, 17, 21, 13, 6306, 22900, 77, 32674, 9285, 14023, 11, 19685, 811, 27138, 26, 16439, 11, 13897, 320, 17, 15, 16, 15, 568, 12648, 18457, 20079, 13714, 13, 81713, 61670, 13, 33426, 330, 45185, 320, 15909, 68191, 220, 24, 22, 23, 12, 16, 12, 20, 22, 22, 22, 24, 12, 16, 15, 21, 12, 20, 624, 17, 22, 13, 6306, 330, 3838, 8713, 279, 16259, 594, 356, 1775, 285, 21154, 30, 2009, 9975, 20731, 7946, 594, 38425, 3263, 9864, 86, 4056, 905, 13, 57791, 220, 17, 19, 5768, 220, 17, 15, 16, 22, 624, 17, 23, 13, 6306, 10562, 12556, 11, 15115, 320, 18, 6652, 220, 17, 15, 17, 15, 568, 330, 52006, 2115, 448, 1101, 825, 5562, 438, 1059, 27430, 294, 1775, 72, 93055, 8725, 364, 1055, 2310, 4231, 6, 3263, 576, 24454, 13, 57791, 220, 16, 23, 5813, 220, 17, 15, 16, 23, 624, 17, 24, 13, 6306, 4463, 6863, 11, 22325, 12642, 320, 17, 15, 5470, 220, 17, 15, 17, 16, 568, 330, 52006, 594, 501, 272, 1775, 72, 89721, 525, 6941, 1283, 8674, 323, 18696, 13143, 3728, 3263, 576, 21330, 812, 1515, 13, 57791, 220, 17, 16, 5470, 220, 17, 15, 17, 16, 624, 18, 15, 13, 6306, 72311, 613, 11, 34935, 320, 16, 18, 5534, 220, 17, 15, 17, 16, 568, 330, 52006, 364, 41968, 272, 1775, 72, 41189, 6, 553, 13615, 389, 25179, 594, 220, 16, 15, 15, 339, 15198, 3263, 20957, 13, 57791, 220, 16, 19, 5534, 220, 17, 15, 17, 16, 624, 18, 16, 13, 6306, 330, 785, 16259, 594, 7996, 356, 1775, 72, 2160, 15021, 323, 279, 8031, 2160, 758, 6254, 337, 480, 3263, 4120, 13, 57791, 220, 16, 15, 6156, 220, 17, 15, 16, 23, 624, 38425, 23132, 198, 91, 220, 348, 220, 259, 220, 384, 220, 45781, 57145, 35721, 91, 38425, 760, 220, 68283, 7441, 45781, 356, 1775, 72, 220, 10621, 45781, 25685, 82908, 18457, 220, 5235, 323, 24548, 10127, 7253, 220, 6795, 10881, 45781, 356, 1775, 72, 220, 1345, 5774, 5604, 10127, 7253, 220, 45781, 356, 1775, 72, 220, 45781, 23946, 1515, 220, 45781, 472, 795, 220, 45781, 82908, 18457, 220, 45781, 10464, 261, 9390, 13029, 220, 45781, 1982, 7253, 9248, 91, 356, 4626, 760, 220, 86713, 8462, 35852, 220, 68283, 7441, 35852, 220, 647, 352, 77, 337, 35852, 220, 45781, 5235, 35852, 9248, 91, 82908, 760, 220, 11461, 1389, 18596, 45781, 18634, 31912, 220, 19420, 16948, 45781, 18634, 31912, 220, 2823, 360, 1466, 12307, 377, 832, 18596, 220, 5235, 45781, 18634, 31912, 220, 11427, 377, 87121, 8108, 8436, 9971, 354, 220, 39240, 8108, 31912, 220, 444, 10715, 16948, 538, 31912, 220, 444, 273, 1872, 31912, 220, 45781, 18634, 31912, 9248, 91, 48554, 760, 220, 45781, 23694, 9248, 91, 56528, 760, 220, 11427, 443, 18961, 81107, 220, 45781, 5227, 273, 35344, 9248, 91, 33292, 760, 220, 45781, 68035, 323, 45951, 9248, 91, 220, 348, 220, 259, 220, 384, 220, 38425, 70273, 304, 279, 3639, 15072, 35721, 91, 472, 3095, 760, 220, 2823, 32674, 220, 20070, 75096, 220, 6364, 13282, 75096, 220, 25685, 75096, 220, 5227, 7253, 330, 26490, 7253, 320, 18457, 27775, 68191, 220, 30576, 465, 75096, 220, 26096, 63091, 75096, 220, 45781, 472, 795, 220, 4312, 14106, 5227, 7253, 220, 1232, 21581, 9248, 91, 21707, 12590, 760, 220, 2435, 890, 11903, 13029, 220, 12886, 398, 86171, 657, 10392, 461, 2054, 220, 6364, 356, 13659, 11903, 13029, 220, 6364, 69264, 220, 6364, 66815, 11903, 13029, 220, 8601, 11903, 13029, 220, 23577, 86171, 657, 10392, 461, 2054, 220, 17809, 10392, 461, 2054, 220, 25867, 69264, 220, 79276, 10392, 461, 2054, 220, 21635, 330, 9084, 320, 18457, 27775, 68191, 220, 69508, 11903, 13029, 220, 45781, 66815, 11903, 13029, 9248, 91, 10127, 17291, 760, 760, 220, 760, 220, 760, 220, 12448, 760, 760, 22150, 57145, 760, 220, 362, 2690, 1574, 10127, 7253, 220, 13093, 42647, 10127, 7253, 220, 13992, 10127, 7253, 220, 94841, 77, 10127, 7253, 220, 422, 437, 645, 44773, 20416, 10127, 7253, 220, 7607, 24909, 10127, 7253, 220, 47662, 18123, 10127, 7253, 220, 19361, 10127, 7253, 220, 58692, 10127, 7253, 220, 83123, 10127, 7253, 220, 4270, 930, 24909, 10127, 7253, 220, 393, 1650, 34183, 10127, 7253, 220, 1818, 62273, 10127, 7253, 220, 26096, 10127, 7253, 220, 1345, 5774, 5604, 10127, 7253, 220, 4818, 9011, 10127, 7253, 220, 50725, 13282, 10127, 7253, 220, 64303, 31003, 10127, 7253, 220, 45781, 10127, 7253, 220, 4312, 64087, 5807, 10127, 7253, 220, 19378, 13282, 10127, 7253, 760, 760, 21603, 57145, 760, 220, 6364, 21603, 10127, 7253, 320, 14417, 609, 24548, 8, 330, 22574, 21603, 10127, 7253, 320, 14417, 609, 24548, 68191, 220, 50227, 10127, 7253, 760, 760, 21622, 4494, 760, 220, 21622, 323, 1982, 7253, 220, 21622, 10127, 7253, 220, 19643, 1568, 21622, 10127, 7253, 220, 62474, 14909, 21622, 10127, 7253, 760, 9248, 91, 6252, 6968, 12590, 760, 220, 2823, 20958, 12905, 645, 220, 13992, 12905, 645, 220, 6795, 10881, 45781, 356, 1775, 72, 220, 38534, 96314, 1260, 7865, 220, 10621, 6364, 82908, 18457, 220, 68283, 7441, 45781, 356, 1775, 72, 220, 57321, 12905, 645, 220, 1417, 295, 1933, 82908, 18457, 220, 9082, 2566, 330, 41885, 2566, 320, 18457, 68191, 220, 50725, 12905, 645, 220, 45781, 82908, 18457, 9248, 91, 6944, 760, 220, 56654, 538, 220, 21622, 96513, 3092, 220, 49130, 1268, 6210, 14927, 11903, 13029, 220, 6364, 36482, 3092, 220, 6210, 14927, 11903, 13029, 220, 16926, 758, 3083, 14254, 9248, 91, 9447, 7800, 760, 220, 5235, 323, 24548, 10127, 7253, 220, 8697, 6898, 10127, 7253, 220, 26064, 75096, 220, 91682, 82908, 18457, 220, 12886, 220, 63982, 69, 461, 433, 34448, 5235, 323, 24548, 13282, 75096, 220, 6364, 9959, 11903, 13029, 220, 6364, 5807, 10127, 7253, 220, 58692, 11903, 13029, 220, 4787, 14106, 2823, 32674, 220, 10621, 6364, 56654, 538, 220, 10621, 45781, 25685, 82908, 18457, 220, 81787, 3179, 10127, 7253, 220, 16244, 472, 795, 220, 88458, 940, 305, 795, 220, 794, 33756, 795, 220, 17589, 6331, 472, 795, 330, 51, 278, 6331, 320, 18457, 27775, 68191, 220, 21603, 56654, 538, 220, 21603, 350, 33369, 11903, 13029, 220, 11999, 2154, 275, 5562, 220, 61698, 291, 9959, 11903, 13029, 220, 45781, 8108, 1515, 9248, 91, 20768, 25, 12905, 550, 11, 62605, 10127, 17291, 11, 13282, 10127, 17291, 11, 1293, 80034, 323, 326, 2574, 388, 9248, 91, 220, 348, 220, 259, 220, 384, 220, 6252, 6968, 323, 6973, 4405, 12590, 35721, 91, 220, 12990, 517, 330, 32913, 517, 320, 18457, 68191, 220, 13369, 356, 4626, 14254, 220, 13369, 730, 1267, 645, 220, 13369, 58546, 220, 13369, 794, 6752, 36079, 356, 4626, 14254, 220, 14662, 591, 58546, 14254, 220, 2823, 20958, 12905, 645, 220, 2823, 20436, 19540, 220, 48062, 58546, 220, 30682, 28089, 1015, 58546, 220, 68625, 25898, 567, 220, 8697, 444, 2757, 220, 51350, 336, 1103, 58546, 220, 13992, 12905, 645, 220, 29954, 46716, 939, 73907, 15209, 220, 29954, 46716, 939, 434, 1933, 416, 220, 54758, 567, 220, 2980, 409, 910, 8832, 220, 356, 2145, 78703, 3313, 1594, 44134, 4942, 220, 356, 2145, 1853, 506, 27557, 220, 356, 2145, 350, 509, 4616, 460, 220, 6795, 10881, 45781, 356, 1775, 72, 220, 356, 4798, 11264, 613, 5652, 2363, 331, 13243, 220, 356, 4798, 20932, 5397, 220, 88472, 18166, 4260, 97538, 14254, 220, 80844, 82908, 18457, 220, 12905, 645, 320, 49, 1384, 8, 220, 12905, 645, 320, 83526, 8, 220, 99070, 82908, 18457, 220, 23234, 58546, 220, 6364, 58546, 220, 13452, 78, 2367, 82908, 18457, 220, 57853, 444, 676, 71, 1241, 220, 10620, 12452, 393, 5054, 8698, 220, 12193, 2577, 1103, 58546, 220, 479, 2863, 958, 31912, 18457, 220, 5938, 58546, 220, 26592, 13757, 220, 99148, 82908, 18457, 220, 6210, 58546, 220, 730, 1749, 645, 220, 38534, 96314, 1260, 7865, 220, 49055, 618, 1103, 6252, 1107, 220, 6879, 84786, 31912, 5562, 220, 54651, 370, 5562, 220, 19643, 1568, 3693, 58546, 220, 386, 20536, 220, 451, 268, 1415, 6252, 6968, 4929, 11496, 220, 1532, 16911, 51349, 14254, 220, 44621, 425, 12540, 1241, 220, 10621, 6364, 82908, 18457, 220, 10621, 5938, 6252, 6968, 38425, 320, 26017, 450, 28932, 8, 220, 23640, 460, 15230, 9668, 90450, 384, 1594, 32371, 269, 2143, 220, 68283, 7441, 45781, 356, 1775, 72, 220, 31984, 12041, 1933, 82908, 18457, 220, 42188, 82908, 18457, 220, 393, 23602, 220, 393, 24336, 220, 5355, 46909, 276, 82908, 18457, 220, 328, 53790, 1103, 58546, 14254, 220, 5016, 391, 408, 7072, 220, 5016, 573, 712, 440, 220, 1417, 295, 1933, 82908, 18457, 220, 14994, 2157, 50996, 318, 324, 3756, 14254, 220, 9082, 2566, 330, 41885, 2566, 320, 18457, 68191, 220, 15154, 9959, 14254, 220, 30109, 444, 676, 71, 1241, 220, 30109, 78663, 71, 1241, 220, 71974, 10127, 7253, 220, 45781, 82908, 18457, 220, 5807, 58546, 220, 5807, 29691, 58546, 14254, 9248, 91, 220, 348, 220, 259, 220, 384, 220, 3089, 11042, 10604, 12590, 35721, 91, 328, 832, 12590, 760, 220, 1674, 78351, 9045, 7891, 220, 1674, 78351, 8394, 309, 1070, 220, 11888, 58369, 11366, 14254, 220, 48235, 1941, 330, 1143, 258, 1941, 320, 18457, 68191, 220, 910, 3101, 354, 4554, 94412, 5562, 220, 19461, 75096, 220, 72678, 14254, 220, 13532, 21848, 220, 28449, 9686, 4554, 328, 832, 14254, 220, 32391, 56863, 10948, 9045, 7891, 220, 8224, 2253, 291, 220, 67500, 1103, 27897, 7891, 220, 70868, 332, 1103, 4929, 11496, 220, 38767, 11866, 258, 27897, 7891, 9248, 91, 44254, 12590, 760, 220, 5235, 44621, 3984, 30664, 795, 220, 6326, 67500, 1103, 4929, 11496, 220, 57853, 3089, 11042, 220, 472, 29802, 59238, 1087, 3984, 30664, 795, 220, 95165, 74, 3779, 78, 330, 39, 562, 74, 3779, 78, 320, 18457, 68191, 220, 619, 34999, 220, 50610, 14259, 220, 95231, 91798, 23985, 14254, 220, 95231, 385, 7276, 6130, 812, 4929, 11496, 220, 730, 812, 84, 14259, 220, 8011, 10681, 1716, 724, 64201, 220, 44621, 3984, 30664, 795, 220, 44621, 68181, 2636, 1241, 220, 393, 28122, 276, 5562, 220, 92891, 87635, 4929, 11496, 220, 1417, 34938, 758, 84, 220, 1417, 1579, 16493, 220, 619, 66897, 339, 1241, 220, 28289, 14254, 220, 4312, 67500, 1103, 4929, 11496, 220, 1863, 14348, 2907, 9248, 91, 6252, 6968, 12590, 760, 220, 6795, 10881, 45781, 356, 1775, 72, 220, 57853, 444, 676, 71, 1241, 220, 99148, 82908, 18457, 220, 49055, 618, 1103, 6252, 1107, 220, 451, 268, 1415, 6252, 6968, 4929, 11496, 220, 44621, 425, 12540, 1241, 220, 68283, 7441, 45781, 356, 1775, 72, 220, 30109, 444, 676, 71, 1241, 220, 30109, 78663, 71, 1241, 9248, 91, 14533, 57145, 760, 220, 16358, 6255, 330, 55802, 6255, 320, 18457, 68191, 220, 130726, 128521, 5562, 220, 73958, 73958, 220, 422, 29887, 360, 585, 220, 52383, 4577, 68, 644, 72, 220, 472, 71155, 35192, 14586, 5562, 220, 7748, 3089, 11042, 220, 10769, 3089, 11042, 220, 14133, 8613, 5562, 220, 730, 396, 309, 5559, 5562, 220, 451, 552, 644, 72, 220, 25691, 3101, 40001, 5562, 220, 35116, 5139, 72, 220, 26392, 16914, 4554, 365, 14254, 9248, 91, 68975, 12590, 760, 220, 1674, 78351, 730, 8501, 50610, 220, 3693, 58369, 11366, 14254, 220, 43680, 3089, 11042, 220, 87077, 1268, 220, 5938, 3089, 11042, 256, 488, 6569, 4288, 2111, 320, 95434, 2154, 11042, 8, 256, 488, 393, 25359, 74512, 320, 57, 86, 2375, 2154, 11042, 8, 220, 16926, 758, 3083, 14254, 220, 5016, 573, 712, 440, 220, 18528, 64, 5649, 436, 84, 220, 10882, 79, 3313, 14811, 78, 9248, 91, 9447, 7800, 57145, 760, 220, 81722, 24660, 5562, 220, 479, 361, 5580, 68, 479, 5918, 899, 220, 472, 546, 7748, 14254, 220, 134883, 2338, 79, 11042, 899, 220, 8211, 812, 46300, 14254, 220, 56987, 4832, 276, 23985, 14254, 9248, 91, 20768, 25, 27897, 7891, 11, 4929, 11496, 330, 8747, 11496, 320, 18457, 943, 8, 3975, 350, 768, 283, 9248, 12020, 82612, 504, 8389, 20970, 510, 434, 11237, 57145, 198, 14254, 57145, 70273, 304, 22931, 198, 6252, 6968, 12590, 198, 3089, 11042, 57145, 198, 17506, 11059, 510, 5443, 7855, 6364, 504, 5534, 220, 17, 15, 17, 19, 198, 2009, 26587, 9709, 5326, 304, 7855, 6364, 198, 5443, 294, 2408, 12713, 504, 5534, 220, 17, 15, 17, 19, 198, 28361, 448, 2805, 4008, 198, 10698, 4008, 9071, 42105, 81080, 198, 28361, 448, 364, 42490, 6, 8003, 63482, 198, 26587, 9709, 32821, 63684, 504, 3217, 220, 17, 15, 17, 19, 198, 2009, 9709, 448, 6975, 53392, 12239, 198, 28361, 448, 6975, 53392, 12239, 504, 5534, 220, 17, 15, 17, 18, 198, 47, 8858, 7441, 45781, 356, 1775, 72, 198, 2212, 8544, 198, 522, 1796, 29, 151645, 198, 151644, 77091, 198]
2026-02-04 14:45:19,887 - lmdeploy - INFO - async_engine.py:374 - session=1, history_tokens=0, input_tokens=6591, max_new_tokens=10000, seq_start=True, seq_end=True, step=0, prep=True
2026-02-04 14:45:19,888 - lmdeploy - INFO - turbomind.py:687 - [async_stream_infer] session 1 start
[TM][INFO] [SeqMgr][Create] ID 1
[2026-02-04 14:45:22 DP0] Avg prompt throughput: 656.7 tokens/s, Avg generation throughput: 13.8 tokens/s, Finished: 0 reqs, Unfinished: 1 reqs, Running: 1 reqs, Waiting: 0 reqs, GPU KV cache usage: 2.2%, Prefix cache hit rate: 0.0%
2026-02-04 14:45:27,159 - lmdeploy - INFO - turbomind.py:797 - [async_stream_infer] session 1 done
2026-02-04 14:45:27,160 - lmdeploy - INFO - async_engine.py:496 - session 1 finished, reason "stop", input_tokens 6591, output_tokens 419
INFO:     127.0.0.1:48966 - "POST /v1/chat/completions HTTP/1.1" 200 OK
[2026-02-04 14:45:32 DP0] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 28.2 tokens/s, Finished: 1 reqs, Unfinished: 0 reqs, Running: 1 reqs, Waiting: 0 reqs, GPU KV cache usage: 2.3%, Prefix cache hit rate: 0.0%

[windreamer]

And I am aware that you are using transformers==5.0.0, and I think the latest transformers library have introduced some breaking changes that broke the LMDeploy.

You can refer these PR: #4303 #4304

[tuilakhanh]

And I am aware that you are using transformers==5.0.0, and I think the latest transformers library have introduced some breaking changes that broke the LMDeploy.

You can refer these PR: #4303 #4304

Thanks let me try.

It looks like the transformer version was just pinned at this commit. 9564876

[windreamer]

And I am aware that you are using transformers==5.0.0, and I think the latest transformers library have introduced some breaking changes that broke the LMDeploy.
You can refer these PR: #4303 #4304

Thanks let me try.

It looks like the transformer version was just pinned at this commit. 9564876

Yep. but this is just for v0.12.0 release.

[tuilakhanh]

Thanks, problem fixed. Closing.