ecosyste.ms

EMF server updates

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v4.2.1 - 12/20/2023' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 1 year ago

Emissions Modeling Framework - Version 4.2 [patch 2] - 06/14/2023

EMF

Update library dependencies for EMF server

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 2 years ago

Emissions Modeling Framework - Version 4.2 [patch] - 05/01/2023

EMF

Fix errors when purging and importing control measure database files

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 2 years ago

Emissions Modeling Framework - Version 4.2 - 03/06/2023

EMF

Include input and parameter names as comments when building case run scripts
Add option to copy inputs and parameters when copying a job within a case
Hide "Compare Dataset Fields" from list of QA programs when creating a new QA step
Add new QA program "Compare Multiple Datasets"
Use Apache Ivy for dependency management, update to newer library versions

Upgrading from v4.1

Download the necessary update files

New server WAR file

emf-client.jar
emf_v4.2_libs.zip

New client JAR files

Control measure database updates

CMDB_2022-05-25.-.DEV.zip

Database updates

Before starting, shut down the Tomcat server.

Add new QA program:

INSERT INTO emf.qa_programs (name, run_classname)
VALUES ('Compare Multiple Datasets',
'gov.epa.emissions.framework.services.qa.comparedatasets.SQLCompareMultipleDatasetsProgramQueryRunner');

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v4.2 - 03/06/2023' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Replace the contents of the EMF/lib client directory with the jar files in the emf_v4.2_libs.zip archive.

Finishing up

Once all updates are complete, start the Tomcat server.

Reload CMDB

If you have custom control measures in your CMDB, first export these measures, so you can reload them after the main update.

Load the updated control measure database from the CMDB_2022-05-25.-.DEV.zip set of files. Purge all existing measures during the import step.

After loading the default CMDB, re-import any custom control measures.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 2 years ago

Emissions Modeling Framework - Version 4.1 - 06/27/2022

EMF

Strengthen password requirements including increasing the minimum length to 12 characters and requiring the password to include numbers or symbols
Automatically disable accounts after 5 failed login attempts
Add options for administrators to disable accounts, see failed login attempts, and see when passwords were last updated

Upgrading from v4.0

Download the necessary update files

New server WAR file

New client JAR files

Cost_Schema_Upgrade.v4_0.sql
cost_equations_v2.sql
populate_least_cost_strategy_worksheet.sql
run_max_emis_red_strategy.sql
run_multi_pollutant_max_emis_red_strategy.sql

Database updates

Before starting, shut down the Tomcat server.

Add fields to the users table:

ALTER TABLE emf.users ADD COLUMN last_reset_date TIMESTAMP;
ALTER TABLE emf.users ADD COLUMN failed_login_attempts INT DEFAULT 0;

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v4.1 - 06/27/2022' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new epa-commons.jar file into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 3 years ago

Emissions Modeling Framework - Version 4.0 - 02/28/2022

EMF

Completed updates to core EMF for better accessibility
Added matching by region code and facility ID to temporal allocation functionality

CoST

Updated control strategy dataset types to handle longer data fields
Added equation type 21 for use by non-EGU SO2 control measures

Upgrading from v3.10.1

Download the necessary update files

Control measure database updates

Temporal allocation updates

create_daily_temporal_allocation_xref.sql
create_monthly_temporal_allocation_xref.sql

New server WAR file

emf-client.jar
analysis-engine.jar
epa-commons.jar
log4j-1.2.17-rhel.jar

New client JAR files

Database updates

Before starting, shut down the Tomcat server.

Update dataset type and add new cost equation:

\i Cost_Schema_Upgrade.v4_0.sql

Update stored procedures:

\i cost_equations_v2.sql
\i populate_least_cost_strategy_worksheet.sql
\i run_max_emis_red_strategy.sql
\i run_multi_pollutant_max_emis_red_strategy.sql
\i create_daily_temporal_allocation_xref.sql
\i create_monthly_temporal_allocation_xref.sql

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v4.0 - 02/28/2022' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new analysis-engine.jar, epa-commons.jar, and log4j-1.2.17-rhel.jar files into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 3 years ago

Emissions Modeling Framework - Version 3.10.1 - 11/04/2021

EMF

Fix bug that prevents editing a case job

Upgrading from v3.10

Download the necessary update files

New client JAR file

EMF server updates

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.10.1 - 11/04/2021' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 3 years ago

Emissions Modeling Framework - Version 3.10 - 10/29/2021

EMF

Enhancements to keyboard navigation and screen reader compatibility
Improve user interface focus after refreshes are performed
Add feedback when an action can't be performed due to no item being selected
Fixes to incorrect tooltips and added button shortcuts
Added ability to type in more letters to the Show Datasets of Type menu in the Dataset Manager

Upgrading from v3.9.1

Download the necessary update files

New client JAR files

Control measure database updates

CMDB_2021-09-02.zip

EMF server updates

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.10 - 10/29/2021' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new epa-commons.jar file into the EMF/lib client directory.

Reload CMDB

If you have custom control measures in your CMDB, first export these measures, so you can reload them after the main update.

Load the updated control measure database from the CMDB_2021-09-02.zip set of files. Purge all existing measures during the import step.

After loading the default CMDB, re-import any custom control measures.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 3 years ago

Emissions Modeling Framework - Version 3.9.1 - 06/07/2021

EMF

Temporarily remove accessibility updates to the data viewer and editor tables that cause issues with the column headers scrolling in Java 8

Upgrading from v3.9

Download the necessary update files

New client JAR files

cost_equations_v2.sql
populate_least_cost_strategy_worksheet.sql
run_max_emis_red_strategy.sql
run_multi_pollutant_max_emis_red_strategy.sql

EMF server updates

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.9.1 - 06/07/2021' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 4 years ago

Emissions Modeling Framework - Version 3.9 - 05/30/2021

CoST

Update design capacity checks in cost equations to check that values are greater than 0.1 MW/hr rather than just greater than 0
Ensure all design capacity checks in cost equations use consistent units
Add design capacity check to equation type 2a to be consistent with other equation type 2 variants
Fix errors running control strategies by truncating SCC descriptions when creating result datasets

EMF

Fix issues with window focus when closing windows
Enhancements to keyboard navigation and screen reader compatibility
Change default sizes of windows to better fit contents
Enable the User's Guide option in the Help menu
Add shortcut Ctrl+Shift-S to open the Status window
Automatically open the Dataset Manager window when starting the EMF Client
Check for spaces in filenames when trying to upload or import files

Upgrading from v3.8

Download the necessary update files

Control measure database updates

CMDB_2021-03-11.zip

New server WAR file

emf-client.jar
analysis-engine.jar
epa-commons.jar

New client JAR files

Database updates

Before starting, shut down the Tomcat server.

Update stored procedures:

\i cost_equations_v2.sql
\i populate_least_cost_strategy_worksheet.sql
\i run_max_emis_red_strategy.sql
\i run_multi_pollutant_max_emis_red_strategy.sql

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.9 - 05/30/2021' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new analysis-engine.jar and epa-commons.jar files into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Reload CMDB

If you have custom control measures in your CMDB, first export these measures, so you can reload them after the main update.

Load the updated control measure database from the CMDB_2021-03-11.zip set of files. Purge all existing measures during the import step.

After loading the default CMDB, re-import any custom control measures.

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 4 years ago

Emissions Modeling Framework - Version 3.8 - 03/08/2021

CoST

Log inventory sources with >= 100% control and non-zero emissions in the Strategy Messages dataset
Update calculation of projected inventory percent reduction for add-on controls
Update check for existing control at >= 100% when considering replacements in PFYI strategy
Add equation type 2c based on existing type 2 with design capacity in HP

EMF

Enhancements to keyboard-only navigation
Label error messages that were previously only indicated by color

Upgrading from v3.7

Download the necessary update files

Control measure database updates

Cost_Schema_Upgrade_v3_8.sql
CMDB_2021-02-25.zip

cost_equations_v2.sql
create_projected_future_year_inventory.sql
populate_project_future_year_inventory_strategy_messages.sql
populate_strategy_messages.sql
run_project_future_year_inventory.sql

New server WAR file

emf-client.jar
analysis-engine.jar
epa-commons.jar

New client JAR files

Database updates

Before starting, shut down the Tomcat server.

Add Equation Type 2c and its parameters:

\i Cost_Schema_Upgrade_v3_8.sql

Update stored procedures:

\i cost_equations_v2.sql
\i create_projected_future_year_inventory.sql
\i populate_project_future_year_inventory_strategy_messages.sql
\i populate_strategy_messages.sql
\i run_project_future_year_inventory.sql

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.8 - 03/08/2021' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new analysis-engine.jar and epa-commons.jar files into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Reload CMDB

If you have custom control measures in your CMDB, first export these measures, so you can reload them after the main update.

Load the updated control measure database from the CMDB_2021-02-25.zip set of files. Purge all existing measures during the import step.

After loading the default CMDB, re-import any custom control measures.

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 4 years ago

Emissions Modeling Framework - Version 3.7 - 08/17/2020

CoST

Add search options when selecting control programs for Project Future Year Inventory control strategies, and in the Control Program Manager
Add .csv suffix when exporting various control strategy result datasets
Fix issue saving edited control measure equation changes
Fix end condition for least cost narrowing algorithm
Add option to include dataset_id column when exporting flexible format datasets from control strategies
Update naming for combined strategy detailed results file to use control strategy name

EMF

Update case job cancelling for jobs that are started locally (not via SSH)

Upgrading from v3.6

Download the necessary update files

Control measure database updates

Cost_Schema_Upgrade_v3_7.sql
narrow_in_on_least_cost_target.sql

New server WAR file

New client JAR files

cost_equations_v2.sql
populate_least_cost_strategy_worksheet.sql
run_max_emis_red_strategy.sql
run_multi_pollutant_max_emis_red_strategy.sql

Database updates

Before starting, shut down the Tomcat server.

Add EXPORT_SUFFIX keyword for control strategy result types:

\i Cost_Schema_Upgrade_v3_7.sql

Update stored procedures:

\i narrow_in_on_least_cost_target.sql

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.7 - 08/17/2020' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new epa-commons.jar file into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Emissions - Emission Observation and Modeling - Java
Published by cseppan almost 5 years ago

Emissions Modeling Framework - Version 3.6 - 05/15/2020

CoST

Fix a memory issue when creating controlled inventories from Least Cost control strategies
Clarify the description of replacement control measure handling on the Control Strategy Constraints tab
Update control strategies to not apply controls to inventory sources with existing control efficiencies over 100%
Update cost equation type 2b to only apply to sources whose design capacity is less than 1500 HP
Fix description for cost equation type 1
Add option to export multiple Strategy Detailed Results in a single file
Add quick search to the Control Strategy Manager window

EMF

Add quick search to the Dataset Type Manager window

Upgrading from v3.5

Download the necessary update files

Control measure database updates

New server WAR file

New client JAR files

Cost_Schema_Upgrade_v3_5.sql
CMDB_2019-10-09.zip

Database updates

Before starting, shut down the Tomcat server.

Update stored procedures:

\i cost_equations_v2.sql
\i populate_least_cost_strategy_worksheet.sql
\i run_max_emis_red_strategy.sql
\i run_multi_pollutant_max_emis_red_strategy.sql

Update equation description:

UPDATE emf.equation_types SET equation =
'Scaling Factor = (Model Plant boiler capacity / MW) ^ (Scaling Factor Exponent)
Capital Cost = Capital Cost Multiplier x Design Capacity x Scaling Factor x 1,000
Fixed O&M = Fixed O&M Cost Multiplier x Design Capacity x Scaling Factor x 1,000
Variable O&M = Variable O&M Cost Multiplier x Design Capacity x Capacity Factor x 8,760'
WHERE name = 'Type 1';

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.6 - 05/15/2020' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new epa-commons.jar file into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Emissions - Emission Observation and Modeling - Java
Published by cseppan about 5 years ago

Emissions Modeling Framework - Version 3.5 - 10/23/2019

CoST

Update reference year cost-per-ton storage to use double precision
Update implicit price deflators, used for cost year conversions, using values from August 2019
Simplify cost equation type 8 (used for non-EGU PM2.5 controls) and add a new equation type 20 (used for ICI boilers)
Revisions to the control measure database
Add additional columns to the Control Strategy Detailed Result Extended dataset type, to contain inventory data used in cost equation calculations
Fix errors running control strategies on inventories with no sector set

Upgrading from v3.4

Download the necessary update files

Control measure database updates

apply_cap_measures_on_hap_pollutants.sql
cost_equations_v2.sql
populate_least_cost_strategy_detailed_result.sql
populate_least_cost_strategy_worksheet.sql
run_max_emis_red_strategy.sql
run_multi_pollutant_max_emis_red_strategy.sql
update_gdplev_values.sql

New server WAR file

New client JAR file

Database updates

Before starting, shut down the Tomcat server.

Update database schema, add equation types, add columns to strategy detail result dataset type:
Update reference year cost-per-ton data type:

\i Cost_Schema_Upgrade_v3_5.sql

Load updated implicit price deflators:

\i update_gdplev_values.sql

Update stored procedures:

\i apply_cap_measures_on_hap_pollutants.sql
\i cost_equations_v2.sql
\i populate_least_cost_strategy_detailed_result.sql
\i populate_least_cost_strategy_worksheet.sql
\i run_max_emis_red_strategy.sql
\i run_multi_pollutant_max_emis_red_strategy.sql

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.5 - 10/23/2019' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Reload CMDB

If you have custom control measures in your CMDB, first export these measures, so you can reload them after the main update.

Load the updated control measure database from the CMDB_2019-10-09.zip set of files. Purge all existing measures during the import step.

After loading the default CMDB, re-import any custom control measures.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 5 years ago

Emissions Modeling Framework - Version 3.4 - 10/10/2019

EMF

New option to export a specific version of a module type
Updates to support dataset matching when importing modules via the case manager
Support for exporting and importing composite modules
New search option in module manager
Allow modules with optional, unset input datasets to be finalized

Upgrading from v3.3

Download the necessary update files

New server WAR file

New client JAR files

populate_least_cost_strategy_detailed_result.sql
populate_least_cost_strategy_worksheet.sql
populate_project_future_year_inventory_strategy_messages.sql
populate_strategy_messages.sql
run_max_emis_red_strategy.sql
run_multi_pollutant_max_emis_red_strategy.sql
validate_project_future_year_inventory_control_programs.sql

Database updates

Before starting, shut down the Tomcat server.

Update case table:

ALTER TABLE cases.output_queue ADD COLUMN target_version integer;

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.4 - 10/10/2019' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new epa-commons.jar file into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 5 years ago

Emissions Modeling Framework - Version 3.3 - 03/25/2019

EMF

Now requires Java 8 or higher
Updated to work with Java 9 and higher, which supports HiDPI displays on Windows
New version of the EMF Client Installer available to work with Java 9 and higher

CoST

Removed out-of-date control strategy types (Annotate Inventory and Apply Measures In Series)
Removed fixed 3% interest rate calculations from control strategies
Relabeled columns in control strategy summaries and worksheets to match FF10 inventory terminology
Allow control strategies to be run even if the input inventories don't have sectors set

Module system

Reduced the maximum length allowed for module dataset and parameter names to avoid truncation when running the module
Allow required module datasets to be unset
Added option for admin users to delete module history records
Reworked how the module history is fetched to speed up viewing and editing modules
Added option to use module parameters in dataset placeholder names
Updates to work with Postgres 10

Upgrading from v3.2

Download the necessary update files

Control strategy updates

New server WAR file

New client JAR files

control_strategy_detailed_result_extended.csv
Cost_Schema_Upgrade_v3_2.sql

Database updates

Before starting, shut down the Tomcat server.

Fix control technology name:

UPDATE emf.control_technologies
SET name = 'Excess O2 Control'
WHERE name = 'Excess O3 Control';

Mark control measures as obsolete:

UPDATE emf.control_measures
SET cm_class_id = (SELECT id FROM emf.control_measure_classes WHERE name = 'Obsolete')
WHERE abbreviation LIKE 'SICIRIB%';

Remove 3pct columns from Strategy Detail Results dataset type:

DELETE FROM emf.fileformat_columns
WHERE file_format_id = (SELECT id FROM emf.file_formats WHERE name = 'Control Strategy Detailed Result Extended')
AND name IN ('annual_cost_3pct', 'eff_ann_cost_per_ton_3pct', 'annualized_capital_cost_3pct');

Use CSV exporter for Strategy Messages dataset type:

UPDATE emf.dataset_types
SET exporter_classname = 'gov.epa.emissions.commons.io.csv.CSVExporter'
WHERE name = 'Strategy Messages (CSV)';

Update stored procedures:

\i populate_least_cost_strategy_detailed_result.sql
\i populate_least_cost_strategy_worksheet.sql
\i populate_project_future_year_inventory_strategy_messages.sql
\i populate_strategy_messages.sql
\i run_max_emis_red_strategy.sql
\i run_multi_pollutant_max_emis_red_strategy.sql
\i validate_project_future_year_inventory_control_programs.sql

EMF server updates

Copy the new emf.war into the Tomcat webapps directory.

Update the EMF version in the database:

UPDATE emf.properties SET value = 'v3.3 - 03/25/2019' WHERE name = 'EMF-version';

Client updates

Copy the new emf-client.jar file into the EMF client directory.

Copy the new epa-commons.jar file into the EMF/lib client directory.

Finishing up

Once all updates are complete, start the Tomcat server.

Emissions - Emission Observation and Modeling - Java
Published by cseppan over 6 years ago

Emissions Modeling Framework - Version 3.2 - 08/16/2018

EMF

Added ability for admin users to edit dataset type column defintions for Flexible File Format-based dataset types
Improved error messages displayed when importing datasets
Added new option to export and import non-composite modules
When exporting modules, added option to export all the input datasets associated with the selected modules
Removed dataset types that can't be imported from the Import Window dataset type pull-down menu
Added a message explaining why a new dataset version can't be created if there are no existing final versions of the dataset

CoST

Created a new Control Strategy Detailed Result dataset type that uses column names consistent with the Flat File 2010 inventory formats
Added the term "effective" to emission reduction and annual cost per ton column names in the new strategy detailed result dataset type
Updated all control strategy types to output the new detailed result dataset type
Created QA step templates for the new detailed result dataset type based on the old dataset type
Added check to prevent users from trying to create controlled/projected inventories with old strategy detailed results datasets

Upgrading from v3.1

Download the necessary update files

Dataset type updates

Control strategy updates

apply_cap_measures_on_hap_pollutants.sql
create_strategy_detailed_result_table_indexes.sql
populate_least_cost_strategy_detailed_result.sql
populate_strategy_messages.sql
run_apply_measures_in_series_strategy.sql
run_max_emis_red_strategy.sql
run_multi_pollutant_max_emis_red_strategy.sql
run_project_future_year_inventory.sql

New server WAR file

New client JAR files