RayNene commited on
Commit
d416743
·
verified ·
1 Parent(s): 62a4a3e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +126 -133
README.md CHANGED
@@ -1,202 +1,195 @@
1
  ---
2
- base_model: togethercomputer/Meta-Llama-3.3-70B-Instruct-Reference
3
- library_name: peft
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  ---
5
 
6
- # Model Card for Model ID
7
 
8
- <!-- Provide a quick summary of what the model is/does. -->
9
 
 
10
 
 
11
 
12
- ## Model Details
13
-
14
- ### Model Description
15
-
16
- <!-- Provide a longer summary of what this model is. -->
17
-
18
-
19
-
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
- - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
- - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
-
28
- ### Model Sources [optional]
29
-
30
- <!-- Provide the basic links for the model. -->
31
-
32
- - **Repository:** [More Information Needed]
33
- - **Paper [optional]:** [More Information Needed]
34
- - **Demo [optional]:** [More Information Needed]
35
-
36
- ## Uses
37
-
38
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
-
40
- ### Direct Use
41
-
42
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
-
46
- ### Downstream Use [optional]
47
-
48
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
-
50
- [More Information Needed]
51
-
52
- ### Out-of-Scope Use
53
-
54
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
-
56
- [More Information Needed]
57
-
58
- ## Bias, Risks, and Limitations
59
-
60
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
-
62
- [More Information Needed]
63
-
64
- ### Recommendations
65
-
66
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
-
68
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
-
70
- ## How to Get Started with the Model
71
-
72
- Use the code below to get started with the model.
73
-
74
- [More Information Needed]
75
-
76
- ## Training Details
77
 
78
- ### Training Data
79
 
80
- <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
 
82
- [More Information Needed]
83
 
84
- ### Training Procedure
85
 
86
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
 
88
- #### Preprocessing [optional]
89
 
90
- [More Information Needed]
91
 
 
92
 
93
- #### Training Hyperparameters
94
 
95
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
 
 
96
 
97
- #### Speeds, Sizes, Times [optional]
 
98
 
99
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
 
101
- [More Information Needed]
 
 
 
102
 
103
- ## Evaluation
 
 
 
 
104
 
105
- <!-- This section describes the evaluation protocols and provides the results. -->
106
 
107
- ### Testing Data, Factors & Metrics
108
 
109
- #### Testing Data
110
 
111
- <!-- This should link to a Dataset Card if possible. -->
112
 
113
- [More Information Needed]
 
 
114
 
115
- #### Factors
 
 
116
 
117
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
 
 
118
 
119
- [More Information Needed]
 
 
120
 
121
- #### Metrics
 
 
122
 
123
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
 
125
- [More Information Needed]
126
 
127
- ### Results
128
 
129
- [More Information Needed]
 
 
 
130
 
131
- #### Summary
132
 
 
133
 
 
134
 
135
- ## Model Examination [optional]
136
 
137
- <!-- Relevant interpretability work for the model goes here -->
138
 
139
- [More Information Needed]
140
 
141
- ## Environmental Impact
142
 
143
- <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
 
145
- Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
 
147
- - **Hardware Type:** [More Information Needed]
148
- - **Hours used:** [More Information Needed]
149
- - **Cloud Provider:** [More Information Needed]
150
- - **Compute Region:** [More Information Needed]
151
- - **Carbon Emitted:** [More Information Needed]
152
 
153
- ## Technical Specifications [optional]
154
 
155
- ### Model Architecture and Objective
 
 
 
 
 
 
 
 
 
 
 
 
 
156
 
157
- [More Information Needed]
158
 
159
- ### Compute Infrastructure
160
 
161
- [More Information Needed]
162
 
163
- #### Hardware
164
 
165
- [More Information Needed]
166
 
167
- #### Software
168
 
169
- [More Information Needed]
170
 
171
- ## Citation [optional]
172
 
173
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
 
175
- **BibTeX:**
176
 
177
- [More Information Needed]
178
 
179
- **APA:**
 
 
 
 
 
180
 
181
- [More Information Needed]
182
 
183
- ## Glossary [optional]
184
 
185
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
 
187
- [More Information Needed]
188
 
189
- ## More Information [optional]
190
 
191
- [More Information Needed]
192
 
193
- ## Model Card Authors [optional]
194
 
195
- [More Information Needed]
196
 
197
- ## Model Card Contact
198
 
199
- [More Information Needed]
200
- ### Framework versions
201
 
202
- - PEFT 0.15.1
 
1
  ---
2
+ license: llama3.3
3
+ base_model: meta-llama/Llama-3.3-70B-Instruct
4
+ language:
5
+ - en
6
+ library_name: transformers
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - finance
10
+ - financial-literacy
11
+ - investment
12
+ - banking
13
+ - budgeting
14
+ - accounting
15
+ - lora
16
+ - instruction-tuning
17
+ - llama-3
18
+ - adaption-labs
19
+ datasets:
20
+ - RayNene/MyFinanceExpert
21
  ---
22
 
23
+ # MyFinanceExpertModel
24
 
25
+ > **Helping people make more informed financial decisions through accessible AI.**
26
 
27
+ *A finance-specialized LoRA adaptation of Llama 3.3 70B Instruct.*
28
 
29
+ ---
30
 
31
+ ## Why this model exists
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
+ Money influences almost every major life decision, yet financial education often arrives too late—or not at all.
34
 
35
+ Many people receive their first salary without ever learning how to build a budget. Others sign loan agreements without fully understanding interest rates, struggle to compare financial products, or fall victim to increasingly sophisticated scams. For many, professional financial advice is either too expensive, difficult to access, or filled with technical language that makes important decisions even harder.
36
 
37
+ At the same time, AI has become one of the first places people turn to for answers.
38
 
39
+ That creates an opportunity—and a responsibility.
40
 
41
+ MyFinanceExpertModel was built to make financial knowledge more approachable by helping language models explain financial concepts with greater clarity, context, and practical guidance. Rather than simply generating answers, the goal is to support better financial understanding and encourage informed decision-making.
42
 
43
+ ---
44
 
45
+ ## 🚀 How to Use
46
 
47
+ This repository contains **LoRA adapter weights** for **Llama 3.3 70B Instruct**.
48
 
49
+ First, load the base model, then apply the adapter:
50
 
51
+ ```python
52
+ from transformers import AutoModelForCausalLM, AutoTokenizer
53
+ from peft import PeftModel
54
 
55
+ BASE_MODEL = "meta-llama/Llama-3.3-70B-Instruct"
56
+ ADAPTER = "RayNene/MyFinanceExpertModel"
57
 
58
+ tokenizer = AutoTokenizer.from_pretrained(BASE_MODEL)
59
 
60
+ base_model = AutoModelForCausalLM.from_pretrained(
61
+ BASE_MODEL,
62
+ device_map="auto"
63
+ )
64
 
65
+ model = PeftModel.from_pretrained(
66
+ base_model,
67
+ ADAPTER
68
+ )
69
+ ```
70
 
71
+ ---
72
 
73
+ ## 💬 Prompting Tips
74
 
75
+ The model performs best when given realistic financial scenarios rather than short keyword prompts.
76
 
77
+ ### Good prompts
78
 
79
+ ```
80
+ I'm 23 and just received my first salary. Can you help me create a monthly budget that balances rent, savings, emergency funds, and discretionary spending?
81
+ ```
82
 
83
+ ```
84
+ Compare a fixed-rate mortgage and an adjustable-rate mortgage. Which situations is each best suited for?
85
+ ```
86
 
87
+ ```
88
+ I have a credit card with a 22% annual interest rate and a personal loan with a lower interest rate. Which debt should I prioritize paying off first, and why?
89
+ ```
90
 
91
+ ```
92
+ A company reports revenue growth but declining net income. What financial factors could explain this?
93
+ ```
94
 
95
+ ```
96
+ How can I identify common investment scams before committing my money?
97
+ ```
98
 
99
+ ---
100
 
101
+ ## 💡 Best Practices
102
 
103
+ For the highest-quality responses:
104
 
105
+ - Provide relevant financial context.
106
+ - Specify your country or region if asking about taxes or regulations.
107
+ - Mention your goals (saving, investing, budgeting, debt repayment, retirement, etc.).
108
+ - Ask follow-up questions for deeper explanations.
109
 
110
+ For example, instead of asking:
111
 
112
+ > "Should I invest?"
113
 
114
+ Try:
115
 
116
+ > "I'm a recent graduate with \$5,000 in savings, no debt, and a five-year investment horizon. What investment approaches should I research, and what are the risks of each?"
117
 
118
+ ---
119
 
120
+ ## ⚠️ Important Notice
121
 
122
+ MyFinanceExpertModel is intended for **education and research**. Although adapted for financial topics, it should not replace advice from licensed financial, tax, legal, or investment professionals.
123
 
124
+ Always verify important financial information before making significant financial decisions.
125
 
 
126
 
127
+ ## What it specializes in
 
 
 
 
128
 
129
+ The model has been adapted for a wide range of financial topics, including:
130
 
131
+ - Personal finance
132
+ - Budgeting
133
+ - Saving and investing
134
+ - Banking
135
+ - Credit cards and loans
136
+ - Mortgages
137
+ - Insurance
138
+ - Taxes
139
+ - Accounting
140
+ - Corporate finance
141
+ - Financial literacy
142
+ - Fraud detection
143
+ - Scam awareness
144
+ - Risk management
145
 
146
+ ---
147
 
148
+ ## Model Information
149
 
150
+ **Base Model**
151
 
152
+ `meta-llama/Llama-3.3-70B-Instruct`
153
 
154
+ ---
155
 
156
+ ## Training Data
157
 
158
+ The model was adapted using **FinanceExpert Dataset**, a finance-focused instruction tuning dataset containing enhanced prompts, enriched responses, and semantically processed examples covering real-world financial scenarios.
159
 
160
+ The dataset is publicly available on Hugging Face.
161
 
162
+ ---
163
 
164
+ ## Intended Use
165
 
166
+ This model is designed for:
167
 
168
+ - Financial education
169
+ - Personal finance assistants
170
+ - Banking support chatbots
171
+ - Financial literacy applications
172
+ - Research into domain-adapted language models
173
+ - Conversational financial guidance
174
 
175
+ ---
176
 
177
+ ## Limitations
178
 
179
+ Although adapted for financial topics, this model is **not** a substitute for licensed financial, tax, legal, or investment professionals.
180
 
181
+ Responses should be treated as educational information and verified before making significant financial decisions.
182
 
183
+ ---
184
 
185
+ ## Vision
186
 
187
+ Access to financial knowledge should not depend on income, geography, or prior experience.
188
 
189
+ By openly releasing both the model and its training dataset, this project aims to contribute to a future where trustworthy financial education is easier to access for everyone.
190
 
191
+ ---
192
 
193
+ ## Acknowledgements
 
194
 
195
+ Developed as part of the **Adaptation Labs AutoScientist Challenge**, supporting the development of open, domain-specialized language models.