segolilylabs/Lily-Cybersecurity-7B-v0.2

Hugging Face
TEXT GENERATIONPricing:Input $0.4 / Cached $0.08 / Output $0.8Concurrent Unit Cost:1Model Size:7BQuant:FP8Context Size:4kTool Calling:SupportedPublished:Jan 11, 2024License:apache-2.0Architecture:Transformer0.2K Open Weights Featherless Exclusive Warm

Lily-Cybersecurity-7B-v0.2 by segolilylabs is a 7 billion parameter Mistral-based instruction-tuned model with a 4096 token context length. It is specifically fine-tuned on 22,000 hand-crafted cybersecurity and hacking-related data pairs, enhanced with additional LLM-generated context and personality. This model is designed to function as a helpful and friendly cybersecurity assistant, providing detailed explanations across a broad spectrum of cybersecurity topics.

Loading preview...

Lily-Cybersecurity-7B-v0.2: A Specialized Cybersecurity Assistant

Lily-Cybersecurity-7B-v0.2, developed by segolilylabs, is a 7 billion parameter model built upon the Mistral-7B-Instruct-v0.2 architecture. Its core distinction lies in its specialized fine-tuning on a unique dataset comprising 22,000 hand-crafted cybersecurity and hacking-related data pairs. This dataset was further processed by an LLM to imbue the model with additional context, a distinct personality, and refined output styling, aiming for a helpful and friendly tone.

Key Capabilities

  • Broad Cybersecurity Knowledge: Covers an extensive range of cybersecurity domains, including APT management, cloud security, digital forensics, incident response, penetration testing, risk management, secure SDLC, and malware analysis.
  • Instruction-Tuned for Assistance: Designed to act as a subject matter expert, providing detailed and truthful answers to cybersecurity queries.
  • Personality-Enhanced Responses: Outputs are styled to be engaging and friendly, as demonstrated by the example prompt response.

Training and Limitations

The model underwent 5 epochs of training over 24 hours on a single A100 GPU. As a fine-tune of Mistral-7B-Instruct-v0.2, Lily inherits biases from its base model. Users should be aware that, like all LLMs, it can make mistakes and important information should be verified. Ethical and legal use is strongly advised.

Popular Sampler Settings

Top 3 parameter combinations used by Featherless users for this model. Click a tab to see each config.

temperature
top_p
top_k
frequency_penalty
presence_penalty
repetition_penalty
min_p